Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29251 originally caused by: Started by upstream project "master-osmo-msc" build number 34192 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7502 originally caused by: Started by upstream project "master-osmo-bts" build number 7563 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5529 originally caused by: Started by upstream project "master-osmo-bts" build number 7563 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8033 originally caused by: Started by upstream project "master-osmo-bts" build number 7563 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17648 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7502 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6676 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8695 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8940 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2940 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29251 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5148 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30028 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4672 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12961 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9235 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4693 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8033 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5187 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5529 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3905 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins3590857716725919513.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 00:40:15 + trial_dir_prefix=trial- + rm -rf trial-2351 trial-2351-bin.tgz trial-2351-run.tgz + trial_dir=trial-2352 + mkdir -p trial-2352 + mv open5gs.build-8.tgz osmo-bsc.build-17648.tgz osmo-bts-oc2g.build-5529.tgz osmo-bts-sysmo.build-8033.tgz osmo-bts.build-7502.tgz osmo-ggsn.build-6676.tgz osmo-hlr.build-8695.tgz osmo-hnbgw.build-2940.tgz osmo-mgw.build-8940.tgz osmo-msc.build-29251.tgz osmo-nitb.build-12961.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30028.tgz osmo-stp.build-9235.tgz osmo-trx.build-4672.tgz osmocom-bb.build-4693.tgz srslte.build-19.tgz trial-2352 + cat open5gs.build-8.md5 osmo-bsc.build-17648.md5 osmo-bts-oc2g.build-5529.md5 osmo-bts-sysmo.build-8033.md5 osmo-bts.build-7502.md5 osmo-ggsn.build-6676.md5 osmo-hlr.build-8695.md5 osmo-hnbgw.build-2940.md5 osmo-mgw.build-8940.md5 osmo-msc.build-29251.md5 osmo-nitb.build-12961.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30028.md5 osmo-stp.build-9235.md5 osmo-trx.build-4672.md5 osmocom-bb.build-4693.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17648.md5 osmo-bts-oc2g.build-5529.md5 osmo-bts-sysmo.build-8033.md5 osmo-bts.build-7502.md5 osmo-ggsn.build-6676.md5 osmo-hlr.build-8695.md5 osmo-hnbgw.build-2940.md5 osmo-mgw.build-8940.md5 osmo-msc.build-29251.md5 osmo-nitb.build-12961.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30028.md5 osmo-stp.build-9235.md5 osmo-trx.build-4672.md5 osmocom-bb.build-4693.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2352 combinations: None trial: 'trial-2352' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2352 -------------------------------------------------------------------------------------------- 00:40:26.431864 tst trial-2352: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/log --------------------------------------------------------------------- trial-2352 nitb_sms:sysmo --------------------------------------------------------------------- 00:42:33.486002 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:42:33.489732 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 00:42:33.511054 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 00:42:33.518823 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 00:42:33.572621 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 00:42:33.594164 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 00:42:33.601209 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 00:42:34.140545 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 00:42:34.146740 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 00:42:34.158029 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 00:42:34.526283 tst mo_mt_sms.py: using LAC 17876 00:42:34.760742 tst mo_mt_sms.py: using RAC 26 00:42:34.879335 tst mo_mt_sms.py: using CellId 17876 00:42:34.993368 tst mo_mt_sms.py: using BVCI 17877 00:42:35.099512 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 00:42:35.280462 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 00:42:35.399581 tst mo_mt_sms.py:9: start nitb and bts... 00:42:35.618737 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:42:37.990212 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2933): Launched 00:42:38.316644 run osmo-nitb_10.42.42.2(pid=2934): Launched 00:42:38.494488 run osmo-nitb_10.42.42.2(pid=2934): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2934)] 00:42:38.627776 run osmo-nitb_10.42.42.2(pid=2934): stdout: | (launched: 2022-12-09_00:42:38.256123) 00:42:38.762702 run osmo-nitb_10.42.42.2(pid=2934): stderr: | (launched: 2022-12-09_00:42:38.304657) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:42:38.897631 run osmo-nitb_10.42.42.2(pid=2934): stdout: | (launched: 2022-12-09_00:42:38.256123) 00:42:39.026549 run osmo-nitb_10.42.42.2(pid=2934): stderr: | (launched: 2022-12-09_00:42:38.304657) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:42:39.181094 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=2934): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2934) [trial-2352↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2934)] [trial-2352↪nitb_sms:sysmo↪mo_mt_sms.py:11] 00:42:39.189983 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 00:42:39.196870 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2933): Terminating (SIGTERM) 00:42:39.407937 --- ParallelTerminationStrategy: PID 2933 died... 00:42:39.429731 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2933): Terminated: ok {rc=0} 00:42:39.519064 bus /sierra_3: Setting Powered False 00:42:40.620085 bus /sierra_3: Setting Powered False 00:42:41.739976 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 sms:sysmo --------------------------------------------------------------------- 00:42:42.920728 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:42:42.924651 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 00:42:42.945281 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 00:42:42.973350 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 00:42:43.025735 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 00:42:43.047403 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 00:42:43.074800 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 00:42:43.619029 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 sms:sysmo mo_mt_sms.py ---------------------------------------------- 00:42:43.625554 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:43.636594 tst sms:sysmo: Using 1 x bts (candidates: 1) 00:42:43.672506 tst mo_mt_sms.py: using LAC 17877 00:42:43.800242 tst mo_mt_sms.py: using RAC 27 00:42:43.927659 tst mo_mt_sms.py: using CellId 17877 00:42:44.057815 tst mo_mt_sms.py: using BVCI 17878 00:42:44.176249 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:44.187349 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:44.198285 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:44.209598 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:44.220522 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:44.231558 tst sms:sysmo: Using 1 x modem (candidates: 2) 00:42:44.350739 tst sms:sysmo: Using 1 x modem (candidates: 2) 00:42:44.472553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:42:46.212465 run create_hlr_db(pid=2938): Launched 00:42:46.367730 bus /sierra_2: Setting Powered False 00:42:47.429160 run create_hlr_db(pid=2938): Terminated: ok {rc=0} 00:42:47.880124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2940): Launched 00:42:48.210573 run osmo-hlr_10.42.42.2(pid=2941): Launched 00:42:48.337397 run osmo-stp_10.42.42.5: Starting osmo-stp 00:42:50.918902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2943): Launched 00:42:51.248053 run osmo-stp_10.42.42.5(pid=2944): Launched 00:42:51.373651 run osmo-msc_10.42.42.6: Starting osmo-msc 00:42:56.871251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2946): Launched 00:42:57.198364 run osmo-msc_10.42.42.6(pid=2947): Launched 00:42:57.379946 run osmo-stp_10.42.42.5(pid=2944): ERR: Terminated: ERROR {rc=1} [trial-2352↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2944)] 00:42:57.516772 run osmo-stp_10.42.42.5(pid=2944): stdout: | (launched: 2022-12-09_00:42:51.186599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:42:57.653787 run osmo-stp_10.42.42.5(pid=2944): stderr: | 20221209004251382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004251382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004251382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004251383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004251383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004251383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004251383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:42:57.805518 run osmo-stp_10.42.42.5(pid=2944): stdout: | (launched: 2022-12-09_00:42:51.186599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:42:57.935686 run osmo-stp_10.42.42.5(pid=2944): stderr: | 20221209004251382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004251382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004251382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004251383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004251383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004251383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004251383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:42:58.090500 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=2944): Process ended prematurely: osmo-stp_10.42.42.5(pid=2944) [trial-2352↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2944)] [trial-2352↪sms:sysmo↪mo_mt_sms.py:16] 00:42:58.099734 tst mo_mt_sms.py:16: Test FAILED (14.5 sec) 00:42:58.127568 run osmo-hlr_10.42.42.2(pid=2941): ERR: Terminated: ERROR {rc=237} [trial-2352↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2941)] 00:42:58.178479 run osmo-hlr_10.42.42.2(pid=2941): stdout: | (launched: 2022-12-09_00:42:48.149558) 00:42:58.231312 run osmo-hlr_10.42.42.2(pid=2941): stderr: | 20221209004248350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004248350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004248350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004248350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004248350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004248350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004248363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004248371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004248372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004248372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:42:58.303917 run osmo-msc_10.42.42.6(pid=2947): ERR: Terminated: ERROR {rc=2} [trial-2352↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2947)] 00:42:58.354382 run osmo-msc_10.42.42.6(pid=2947): stdout: | (launched: 2022-12-09_00:42:57.137641) 00:42:58.407160 run osmo-msc_10.42.42.6(pid=2947): stderr: | 20221209004257463 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004257463 DLGLOBAL DEBUG validating counter group 0x7f0facd7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004257463 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004257463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004257463 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004257463 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004257465 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004257465 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004257466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004257466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:42:58.459530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2940): Terminating (SIGTERM) 00:42:58.501593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2943): Terminating (SIGTERM) 00:42:58.543877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2946): Terminating (SIGTERM) 00:42:58.586385 --- ParallelTerminationStrategy: PID 2940 died... 00:42:58.606719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2940): Terminated: ok {rc=0} 00:42:58.653710 --- ParallelTerminationStrategy: PID 2943 died... 00:42:58.673450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2943): Terminated: ok {rc=0} 00:42:58.720013 --- ParallelTerminationStrategy: PID 2946 died... 00:42:58.739784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2946): Terminated: ok {rc=0} 00:42:58.828661 bus /sierra_3: Setting Powered False 00:42:59.929889 bus /sierra_3: Setting Powered False 00:43:01.064642 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_ussd:sysmo --------------------------------------------------------------------- 00:43:02.296206 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:02.301227 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 00:43:02.322942 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 00:43:02.330599 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 00:43:02.368178 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 00:43:02.390823 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 00:43:02.397789 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 00:43:02.938170 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2352 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 00:43:02.946085 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 00:43:02.958041 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 00:43:03.027040 tst assert_extension.py: using LAC 17878 00:43:03.229526 tst assert_extension.py: using RAC 28 00:43:03.387351 tst assert_extension.py: using CellId 17878 00:43:03.514607 tst assert_extension.py: using BVCI 17879 00:43:03.635155 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 00:43:03.750209 tst assert_extension.py:10: start nitb and bts... 00:43:03.954133 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:43:04.575709 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2952): Launched 00:43:04.883232 run osmo-nitb_10.42.42.2(pid=2953): Launched 00:43:05.053263 run osmo-nitb_10.42.42.2(pid=2953): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2953)] 00:43:05.189125 run osmo-nitb_10.42.42.2(pid=2953): stdout: | (launched: 2022-12-09_00:43:04.825982) 00:43:05.327068 run osmo-nitb_10.42.42.2(pid=2953): stderr: | (launched: 2022-12-09_00:43:04.871017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:43:05.464772 run osmo-nitb_10.42.42.2(pid=2953): stdout: | (launched: 2022-12-09_00:43:04.825982) 00:43:05.597230 run osmo-nitb_10.42.42.2(pid=2953): stderr: | (launched: 2022-12-09_00:43:04.871017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2953): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2953) [trial-2352↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2953)] 00:43:06.000216 tst osmo-nitb_10.42.42.2(pid=2953): stdout: | (launched: 2022-12-09_00:43:04.825982) 00:43:06.123630 tst osmo-nitb_10.42.42.2(pid=2953): stderr: | (launched: 2022-12-09_00:43:04.871017) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:43:06.268568 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=2953): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2953) [trial-2352↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2953)] [trial-2352↪nitb_ussd:sysmo↪assert_extension.py:12] 00:43:06.277092 tst assert_extension.py:12: Test FAILED (3.3 sec) 00:43:06.283981 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2952): Terminating (SIGTERM) 00:43:06.493622 --- ParallelTerminationStrategy: PID 2952 died... 00:43:06.515464 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2952): Terminated: ok {rc=0} 00:43:06.603770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 ussd:sysmo --------------------------------------------------------------------- 00:43:07.805214 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:07.809380 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 00:43:07.831026 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 00:43:07.859251 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 00:43:07.895572 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 00:43:07.916363 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 00:43:07.944194 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 00:43:08.471276 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2352 ussd:sysmo assert_extension.py ---------------------------------------------- 00:43:08.476516 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:08.487282 tst ussd:sysmo: Using 1 x bts (candidates: 1) 00:43:08.523196 tst assert_extension.py: using LAC 17879 00:43:08.645031 tst assert_extension.py: using RAC 29 00:43:08.764899 tst assert_extension.py: using CellId 17879 00:43:08.883686 tst assert_extension.py: using BVCI 17880 00:43:08.994042 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:09.004485 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:09.014995 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:09.025777 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:09.036799 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:09.047626 tst ussd:sysmo: Using 1 x modem (candidates: 1) 00:43:09.163622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:09.675127 run create_hlr_db(pid=2957): Launched 00:43:09.808796 bus /sierra_2: Setting Powered False 00:43:10.873996 run create_hlr_db(pid=2957): Terminated: ok {rc=0} 00:43:11.312785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2959): Launched 00:43:11.619983 run osmo-hlr_10.42.42.2(pid=2960): Launched 00:43:11.736651 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:12.265033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2962): Launched 00:43:12.570227 run osmo-stp_10.42.42.5(pid=2963): Launched 00:43:12.688343 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:13.238978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2965): Launched 00:43:13.545161 run osmo-msc_10.42.42.6(pid=2966): Launched 00:43:13.716242 run osmo-stp_10.42.42.5(pid=2963): ERR: Terminated: ERROR {rc=1} [trial-2352↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2963)] 00:43:13.847275 run osmo-stp_10.42.42.5(pid=2963): stdout: | (launched: 2022-12-09_00:43:12.513205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:13.976795 run osmo-stp_10.42.42.5(pid=2963): stderr: | 20221209004312684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004312684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004312684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004312685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004312687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004312687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004312687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:14.104043 run osmo-stp_10.42.42.5(pid=2963): stdout: | (launched: 2022-12-09_00:43:12.513205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:14.225592 run osmo-stp_10.42.42.5(pid=2963): stderr: | 20221209004312684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004312684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004312684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004312685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004312687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004312687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004312687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:14.370350 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=2963): Process ended prematurely: osmo-stp_10.42.42.5(pid=2963) [trial-2352↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2963)] [trial-2352↪ussd:sysmo↪assert_extension.py:17] 00:43:14.378584 tst assert_extension.py:17: Test FAILED (5.9 sec) 00:43:14.405265 run osmo-hlr_10.42.42.2(pid=2960): ERR: Terminated: ERROR {rc=237} [trial-2352↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2960)] 00:43:14.454599 run osmo-hlr_10.42.42.2(pid=2960): stdout: | (launched: 2022-12-09_00:43:11.562498) 00:43:14.505339 run osmo-hlr_10.42.42.2(pid=2960): stderr: | 20221209004311742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004311742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004311742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004311742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004311742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004311742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004311776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004311787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004311787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004311787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:14.575598 run osmo-msc_10.42.42.6(pid=2966): ERR: Terminated: ERROR {rc=2} [trial-2352↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2966)] 00:43:14.624408 run osmo-msc_10.42.42.6(pid=2966): stdout: | (launched: 2022-12-09_00:43:13.486770) 00:43:14.675078 run osmo-msc_10.42.42.6(pid=2966): stderr: | 20221209004313761 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004313761 DLGLOBAL DEBUG validating counter group 0x7efe9d708c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004313762 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004313762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004313762 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004313762 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004313764 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004313764 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004313764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004313764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:14.726037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2959): Terminating (SIGTERM) 00:43:14.766506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2962): Terminating (SIGTERM) 00:43:14.806968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2965): Terminating (SIGTERM) 00:43:14.847641 --- ParallelTerminationStrategy: PID 2959 died... 00:43:14.867034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2959): Terminated: ok {rc=0} 00:43:14.912123 --- ParallelTerminationStrategy: PID 2962 died... 00:43:14.931104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2962): Terminated: ok {rc=0} 00:43:14.976107 --- ParallelTerminationStrategy: PID 2965 died... 00:43:14.994813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2965): Terminated: ok {rc=0} 00:43:15.082571 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:43:16.286638 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:16.294602 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:43:16.318103 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:43:16.347871 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:43:16.402358 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:43:16.424650 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:43:16.455349 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:43:16.999630 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:43:17.054320 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:17.066390 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:43:17.127147 tst mo_mt_call.py: using LAC 17880 00:43:17.249186 tst mo_mt_call.py: using RAC 30 00:43:17.370439 tst mo_mt_call.py: using CellId 17880 00:43:17.492849 tst mo_mt_call.py: using BVCI 17881 00:43:17.605578 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:17.616654 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:17.627656 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:17.638623 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:17.649859 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:17.661427 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:43:17.782769 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:43:17.902171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:18.421090 run create_hlr_db(pid=2971): Launched 00:43:18.555978 bus /sierra_2: Setting Powered False 00:43:19.621871 run create_hlr_db(pid=2971): Terminated: ok {rc=0} 00:43:20.068170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2973): Launched 00:43:20.381380 run osmo-hlr_10.42.42.2(pid=2974): Launched 00:43:20.500709 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:21.050951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2976): Launched 00:43:21.363177 run osmo-stp_10.42.42.5(pid=2977): Launched 00:43:21.481398 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:22.042746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2979): Launched 00:43:22.354070 run osmo-msc_10.42.42.6(pid=2980): Launched 00:43:22.526614 run osmo-stp_10.42.42.5(pid=2977): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2977)] 00:43:22.657984 run osmo-stp_10.42.42.5(pid=2977): stdout: | (launched: 2022-12-09_00:43:21.304620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:22.789277 run osmo-stp_10.42.42.5(pid=2977): stderr: | 20221209004321477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004321477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004321477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004321478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004321478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004321478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004321478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:22.917882 run osmo-stp_10.42.42.5(pid=2977): stdout: | (launched: 2022-12-09_00:43:21.304620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:23.040438 run osmo-stp_10.42.42.5(pid=2977): stderr: | 20221209004321477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004321477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004321477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004321478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004321478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004321478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004321478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:23.187758 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2977): Process ended prematurely: osmo-stp_10.42.42.5(pid=2977) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2977)] [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:43:23.196754 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:43:23.224122 run osmo-hlr_10.42.42.2(pid=2974): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2974)] 00:43:23.273174 run osmo-hlr_10.42.42.2(pid=2974): stdout: | (launched: 2022-12-09_00:43:20.322557) 00:43:23.323944 run osmo-hlr_10.42.42.2(pid=2974): stderr: | 20221209004320503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004320503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004320503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004320503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004320503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004320503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004320515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004320524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004320524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004320524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:23.394127 run osmo-msc_10.42.42.6(pid=2980): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2980)] 00:43:23.442907 run osmo-msc_10.42.42.6(pid=2980): stdout: | (launched: 2022-12-09_00:43:22.295409) 00:43:23.493304 run osmo-msc_10.42.42.6(pid=2980): stderr: | 20221209004322571 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004322571 DLGLOBAL DEBUG validating counter group 0x7f79bdec3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004322571 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004322571 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004322571 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004322571 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004322573 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004322574 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004322574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004322574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:23.544305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2973): Terminating (SIGTERM) 00:43:23.584857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2976): Terminating (SIGTERM) 00:43:23.625471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2979): Terminating (SIGTERM) 00:43:23.666409 --- ParallelTerminationStrategy: PID 2973 died... 00:43:23.685897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2973): Terminated: ok {rc=0} 00:43:23.731349 --- ParallelTerminationStrategy: PID 2976 died... 00:43:23.750405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2976): Terminated: ok {rc=0} 00:43:23.795457 --- ParallelTerminationStrategy: PID 2979 died... 00:43:23.814384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2979): Terminated: ok {rc=0} 00:43:23.899574 bus /sierra_3: Setting Powered False 00:43:24.997686 bus /sierra_3: Setting Powered False 00:43:26.116075 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:43:27.266542 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:27.278635 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:43:27.335937 tst mo_mt_call_osmux.py: using LAC 17881 00:43:27.459536 tst mo_mt_call_osmux.py: using RAC 31 00:43:27.582683 tst mo_mt_call_osmux.py: using CellId 17881 00:43:27.709005 tst mo_mt_call_osmux.py: using BVCI 17882 00:43:27.823748 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:27.834984 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:27.845925 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:27.857106 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:27.868257 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:27.879499 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:43:27.999825 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:43:28.120702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:28.638808 run create_hlr_db(pid=2982): Launched 00:43:28.773610 bus /sierra_2: Setting Powered False 00:43:29.839528 run create_hlr_db(pid=2982): Terminated: ok {rc=0} 00:43:30.284726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2984): Launched 00:43:30.598168 run osmo-hlr_10.42.42.2(pid=2985): Launched 00:43:30.716377 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:31.333889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2987): Launched 00:43:31.673675 run osmo-stp_10.42.42.5(pid=2988): Launched 00:43:31.818810 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:32.557220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2990): Launched 00:43:32.891135 run osmo-msc_10.42.42.6(pid=2991): Launched 00:43:33.074711 run osmo-stp_10.42.42.5(pid=2988): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2988)] 00:43:33.214624 run osmo-stp_10.42.42.5(pid=2988): stdout: | (launched: 2022-12-09_00:43:31.602974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:33.355078 run osmo-stp_10.42.42.5(pid=2988): stderr: | 20221209004331978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004331978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004331979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004331979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004331981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004331981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004331981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:33.494336 run osmo-stp_10.42.42.5(pid=2988): stdout: | (launched: 2022-12-09_00:43:31.602974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:33.626443 run osmo-stp_10.42.42.5(pid=2988): stderr: | 20221209004331978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004331978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004331979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004331979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004331981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004331981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004331981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:33.784459 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2988): Process ended prematurely: osmo-stp_10.42.42.5(pid=2988) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2988)] [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:43:33.793971 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 00:43:33.822153 run osmo-hlr_10.42.42.2(pid=2985): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2985)] 00:43:33.873458 run osmo-hlr_10.42.42.2(pid=2985): stdout: | (launched: 2022-12-09_00:43:30.539050) 00:43:33.925734 run osmo-hlr_10.42.42.2(pid=2985): stderr: | 20221209004330717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004330718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004330718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004330718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004330718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004330718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004330730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004330738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004330739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004330739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:33.998508 run osmo-msc_10.42.42.6(pid=2991): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2991)] 00:43:34.049296 run osmo-msc_10.42.42.6(pid=2991): stdout: | (launched: 2022-12-09_00:43:32.828636) 00:43:34.104158 run osmo-msc_10.42.42.6(pid=2991): stderr: | 20221209004333154 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004333154 DLGLOBAL DEBUG validating counter group 0x7f742ae35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004333155 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004333155 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004333155 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004333155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004333157 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004333157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004333157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004333157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:34.156835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2984): Terminating (SIGTERM) 00:43:34.198833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2987): Terminating (SIGTERM) 00:43:34.241275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2990): Terminating (SIGTERM) 00:43:34.283642 --- ParallelTerminationStrategy: PID 2984 died... 00:43:34.303873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2984): Terminated: ok {rc=0} 00:43:34.350841 --- ParallelTerminationStrategy: PID 2987 died... 00:43:34.370535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2987): Terminated: ok {rc=0} 00:43:34.417719 --- ParallelTerminationStrategy: PID 2990 died... 00:43:34.437390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2990): Terminated: ok {rc=0} 00:43:34.526056 bus /sierra_3: Setting Powered False 00:43:35.627061 bus /sierra_3: Setting Powered False 00:43:36.746054 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:43:37.986469 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:37.993529 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:43:38.015000 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:43:38.042603 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:43:38.096627 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:43:38.117493 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:43:38.144776 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:43:38.701168 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:43:38.754102 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:38.765565 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:43:38.827466 tst mo_mt_call.py: using LAC 17882 00:43:38.957380 tst mo_mt_call.py: using RAC 32 00:43:39.089946 tst mo_mt_call.py: using CellId 17882 00:43:39.220030 tst mo_mt_call.py: using BVCI 17883 00:43:39.341571 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:39.353207 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:39.364584 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:39.376019 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:39.387506 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:39.398915 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:39.514490 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:39.636128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:40.156179 run create_hlr_db(pid=2996): Launched 00:43:40.291268 bus /sierra_2: Setting Powered False 00:43:41.357163 run create_hlr_db(pid=2996): Terminated: ok {rc=0} 00:43:41.822742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2998): Launched 00:43:42.159284 run osmo-hlr_10.42.42.2(pid=2999): Launched 00:43:42.286218 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:42.862446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3001): Launched 00:43:43.197585 run osmo-stp_10.42.42.5(pid=3002): Launched 00:43:43.325887 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:43.932692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3004): Launched 00:43:44.268658 run osmo-msc_10.42.42.6(pid=3005): Launched 00:43:44.454064 run osmo-stp_10.42.42.5(pid=3002): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3002)] 00:43:44.593442 run osmo-stp_10.42.42.5(pid=3002): stdout: | (launched: 2022-12-09_00:43:43.135211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:44.733466 run osmo-stp_10.42.42.5(pid=3002): stderr: | 20221209004343334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004343334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004343334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004343334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004343335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004343335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004343335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:44.872751 run osmo-stp_10.42.42.5(pid=3002): stdout: | (launched: 2022-12-09_00:43:43.135211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:45.005267 run osmo-stp_10.42.42.5(pid=3002): stderr: | 20221209004343334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004343334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004343334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004343334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004343335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004343335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004343335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:45.164231 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3002): Process ended prematurely: osmo-stp_10.42.42.5(pid=3002) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3002)] [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:43:45.173858 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 00:43:45.201813 run osmo-hlr_10.42.42.2(pid=2999): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2999)] 00:43:45.253311 run osmo-hlr_10.42.42.2(pid=2999): stdout: | (launched: 2022-12-09_00:43:42.096610) 00:43:45.306063 run osmo-hlr_10.42.42.2(pid=2999): stderr: | 20221209004342301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004342301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004342301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004342301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004342301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004342301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004342314 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004342322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004342322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004342322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:45.379148 run osmo-msc_10.42.42.6(pid=3005): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3005)] 00:43:45.429776 run osmo-msc_10.42.42.6(pid=3005): stdout: | (launched: 2022-12-09_00:43:44.205576) 00:43:45.482250 run osmo-msc_10.42.42.6(pid=3005): stderr: | 20221209004344536 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004344536 DLGLOBAL DEBUG validating counter group 0x7f38d3dc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004344536 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004344536 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004344536 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004344536 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004344538 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004344539 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004344539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004344539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:45.535121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2998): Terminating (SIGTERM) 00:43:45.577338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3001): Terminating (SIGTERM) 00:43:45.619560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3004): Terminating (SIGTERM) 00:43:45.662002 --- ParallelTerminationStrategy: PID 2998 died... 00:43:45.681807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2998): Terminated: ok {rc=0} 00:43:45.728336 --- ParallelTerminationStrategy: PID 3001 died... 00:43:45.747996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3001): Terminated: ok {rc=0} 00:43:45.794504 --- ParallelTerminationStrategy: PID 3004 died... 00:43:45.814381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3004): Terminated: ok {rc=0} 00:43:45.927289 bus /sierra_3: Setting Powered False 00:43:47.036063 bus /sierra_3: Setting Powered False 00:43:48.152353 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:43:49.306125 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:49.318517 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:43:49.376679 tst mo_mt_call_osmux.py: using LAC 17883 00:43:49.509737 tst mo_mt_call_osmux.py: using RAC 33 00:43:49.641683 tst mo_mt_call_osmux.py: using CellId 17883 00:43:49.773394 tst mo_mt_call_osmux.py: using BVCI 17884 00:43:49.896048 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:49.907721 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:49.919326 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:49.931489 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:49.943025 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:49.954823 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:50.073828 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:50.195467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:50.715786 run create_hlr_db(pid=3007): Launched 00:43:50.851290 bus /sierra_2: Setting Powered False 00:43:51.917298 run create_hlr_db(pid=3007): Terminated: ok {rc=0} 00:43:52.363173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3009): Launched 00:43:52.675963 run osmo-hlr_10.42.42.2(pid=3010): Launched 00:43:52.794027 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:53.343480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3012): Launched 00:43:53.655178 run osmo-stp_10.42.42.5(pid=3013): Launched 00:43:53.773772 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:54.340395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3015): Launched 00:43:54.652799 run osmo-msc_10.42.42.6(pid=3016): Launched 00:43:54.825832 run osmo-stp_10.42.42.5(pid=3013): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3013)] 00:43:54.956744 run osmo-stp_10.42.42.5(pid=3013): stdout: | (launched: 2022-12-09_00:43:53.596506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:55.087860 run osmo-stp_10.42.42.5(pid=3013): stderr: | 20221209004353770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004353770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004353770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004353771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004353771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004353771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004353771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:55.217125 run osmo-stp_10.42.42.5(pid=3013): stdout: | (launched: 2022-12-09_00:43:53.596506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:55.340127 run osmo-stp_10.42.42.5(pid=3013): stderr: | 20221209004353770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004353770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004353770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004353771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004353771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004353771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004353771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:55.487748 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3013): Process ended prematurely: osmo-stp_10.42.42.5(pid=3013) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3013)] [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:43:55.496745 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:43:55.524391 run osmo-hlr_10.42.42.2(pid=3010): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3010)] 00:43:55.573119 run osmo-hlr_10.42.42.2(pid=3010): stdout: | (launched: 2022-12-09_00:43:52.617587) 00:43:55.623280 run osmo-hlr_10.42.42.2(pid=3010): stderr: | 20221209004352794 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004352794 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004352795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004352795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004352795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004352795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004352807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004352816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004352816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004352816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:55.692808 run osmo-msc_10.42.42.6(pid=3016): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3016)] 00:43:55.741216 run osmo-msc_10.42.42.6(pid=3016): stdout: | (launched: 2022-12-09_00:43:54.594068) 00:43:55.791253 run osmo-msc_10.42.42.6(pid=3016): stderr: | 20221209004354872 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004354872 DLGLOBAL DEBUG validating counter group 0x7fdbbf7c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004354872 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004354872 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004354872 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004354873 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004354874 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004354875 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004354875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004354875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:55.842206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3009): Terminating (SIGTERM) 00:43:55.882246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3012): Terminating (SIGTERM) 00:43:55.922392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3015): Terminating (SIGTERM) 00:43:55.962764 --- ParallelTerminationStrategy: PID 3009 died... 00:43:55.982010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3009): Terminated: ok {rc=0} 00:43:56.027082 --- ParallelTerminationStrategy: PID 3012 died... 00:43:56.045982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3012): Terminated: ok {rc=0} 00:43:56.090811 --- ParallelTerminationStrategy: PID 3015 died... 00:43:56.109615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3015): Terminated: ok {rc=0} 00:43:56.196836 bus /sierra_3: Setting Powered False 00:43:57.297137 bus /sierra_3: Setting Powered False 00:43:58.414198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:43:59.647319 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:59.653805 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:43:59.675446 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:43:59.702801 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:43:59.755604 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:43:59.776302 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:43:59.803251 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:44:00.356780 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:44:00.410326 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:00.421946 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:44:00.483072 tst mo_mt_call.py: using LAC 17884 00:44:00.612526 tst mo_mt_call.py: using RAC 34 00:44:00.742550 tst mo_mt_call.py: using CellId 17884 00:44:00.889778 tst mo_mt_call.py: using BVCI 17885 00:44:01.021000 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:01.034338 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:01.047565 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:01.059538 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:01.072544 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:01.086850 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:44:01.209867 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:44:01.349900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:01.932995 run create_hlr_db(pid=3021): Launched 00:44:02.114926 bus /sierra_2: Setting Powered False 00:44:03.180174 run create_hlr_db(pid=3021): Terminated: ok {rc=0} 00:44:03.662723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3023): Launched 00:44:03.998245 run osmo-hlr_10.42.42.2(pid=3024): Launched 00:44:04.126071 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:04.701573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3026): Launched 00:44:05.038882 run osmo-stp_10.42.42.5(pid=3027): Launched 00:44:05.165652 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:05.768874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3029): Launched 00:44:06.104028 run osmo-msc_10.42.42.6(pid=3030): Launched 00:44:06.289556 run osmo-stp_10.42.42.5(pid=3027): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3027)] 00:44:06.429477 run osmo-stp_10.42.42.5(pid=3027): stdout: | (launched: 2022-12-09_00:44:04.975558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:06.569386 run osmo-stp_10.42.42.5(pid=3027): stderr: | 20221209004405172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004405172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004405172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004405173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004405173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004405173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004405173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:06.708336 run osmo-stp_10.42.42.5(pid=3027): stdout: | (launched: 2022-12-09_00:44:04.975558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:06.841205 run osmo-stp_10.42.42.5(pid=3027): stderr: | 20221209004405172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004405172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004405172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004405173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004405173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004405173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004405173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:07.000066 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3027): Process ended prematurely: osmo-stp_10.42.42.5(pid=3027) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3027)] [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:44:07.009932 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 00:44:07.038387 run osmo-hlr_10.42.42.2(pid=3024): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3024)] 00:44:07.089440 run osmo-hlr_10.42.42.2(pid=3024): stdout: | (launched: 2022-12-09_00:44:03.935509) 00:44:07.142175 run osmo-hlr_10.42.42.2(pid=3024): stderr: | 20221209004404138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004404138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004404138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004404138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004404138 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004404138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004404150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004404159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004404159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004404159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:07.215182 run osmo-msc_10.42.42.6(pid=3030): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3030)] 00:44:07.266507 run osmo-msc_10.42.42.6(pid=3030): stdout: | (launched: 2022-12-09_00:44:06.040735) 00:44:07.319053 run osmo-msc_10.42.42.6(pid=3030): stderr: | 20221209004406366 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004406366 DLGLOBAL DEBUG validating counter group 0x7fe2342f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004406367 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004406367 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004406367 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004406367 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004406369 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004406369 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004406369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004406369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:07.371809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3023): Terminating (SIGTERM) 00:44:07.414155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3026): Terminating (SIGTERM) 00:44:07.456508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3029): Terminating (SIGTERM) 00:44:07.499228 --- ParallelTerminationStrategy: PID 3023 died... 00:44:07.519148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3023): Terminated: ok {rc=0} 00:44:07.565993 --- ParallelTerminationStrategy: PID 3026 died... 00:44:07.585667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3026): Terminated: ok {rc=0} 00:44:07.632281 --- ParallelTerminationStrategy: PID 3029 died... 00:44:07.652075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3029): Terminated: ok {rc=0} 00:44:07.741243 bus /sierra_3: Setting Powered False 00:44:08.841564 bus /sierra_3: Setting Powered False 00:44:09.957511 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:44:11.103199 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:11.115113 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:44:11.172260 tst mo_mt_call_osmux.py: using LAC 17885 00:44:11.295778 tst mo_mt_call_osmux.py: using RAC 35 00:44:11.420562 tst mo_mt_call_osmux.py: using CellId 17885 00:44:11.544822 tst mo_mt_call_osmux.py: using BVCI 17886 00:44:11.659339 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:11.670516 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:11.681466 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:11.692601 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:11.703658 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:11.714536 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:44:11.831521 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:44:11.956037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:12.478233 run create_hlr_db(pid=3032): Launched 00:44:12.615369 bus /sierra_2: Setting Powered False 00:44:13.680677 run create_hlr_db(pid=3032): Terminated: ok {rc=0} 00:44:14.125869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3034): Launched 00:44:14.440844 run osmo-hlr_10.42.42.2(pid=3035): Launched 00:44:14.560608 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:15.112415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3037): Launched 00:44:15.424724 run osmo-stp_10.42.42.5(pid=3038): Launched 00:44:15.542818 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:16.132677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3040): Launched 00:44:16.469206 run osmo-msc_10.42.42.6(pid=3042): Launched 00:44:16.977914 run osmo-stp_10.42.42.5(pid=3038): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3038)] 00:44:17.196624 run osmo-stp_10.42.42.5(pid=3038): stdout: | (launched: 2022-12-09_00:44:15.365710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:17.329728 run osmo-stp_10.42.42.5(pid=3038): stderr: | 20221209004415538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004415538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004415538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004415539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004415541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004415541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004415541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:17.462034 run osmo-stp_10.42.42.5(pid=3038): stdout: | (launched: 2022-12-09_00:44:15.365710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:17.586052 run osmo-stp_10.42.42.5(pid=3038): stderr: | 20221209004415538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004415538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004415538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004415539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004415541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004415541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004415541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:17.734604 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3038): Process ended prematurely: osmo-stp_10.42.42.5(pid=3038) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3038)] [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:44:17.743969 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 00:44:17.771397 run osmo-hlr_10.42.42.2(pid=3035): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3035)] 00:44:17.820574 run osmo-hlr_10.42.42.2(pid=3035): stdout: | (launched: 2022-12-09_00:44:14.381293) 00:44:17.871404 run osmo-hlr_10.42.42.2(pid=3035): stderr: | 20221209004414558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004414558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004414558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004414558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004414558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004414559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004414571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004414579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004414579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004414579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:17.942031 run osmo-msc_10.42.42.6(pid=3042): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3042)] 00:44:17.990764 run osmo-msc_10.42.42.6(pid=3042): stdout: | (launched: 2022-12-09_00:44:16.404422) 00:44:18.041424 run osmo-msc_10.42.42.6(pid=3042): stderr: | 20221209004416854 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004416854 DLGLOBAL DEBUG validating counter group 0x7f2c40fbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004416854 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004416855 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004416855 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004416855 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004416858 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004416859 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004416859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004416859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:18.092392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3034): Terminating (SIGTERM) 00:44:18.132927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3037): Terminating (SIGTERM) 00:44:18.173902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3040): Terminating (SIGTERM) 00:44:18.214722 --- ParallelTerminationStrategy: PID 3034 died... 00:44:18.234142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3034): Terminated: ok {rc=0} 00:44:18.279597 --- ParallelTerminationStrategy: PID 3037 died... 00:44:18.298675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3037): Terminated: ok {rc=0} 00:44:18.344311 --- ParallelTerminationStrategy: PID 3040 died... 00:44:18.363364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3040): Terminated: ok {rc=0} 00:44:18.450904 bus /sierra_3: Setting Powered False 00:44:19.550435 bus /sierra_3: Setting Powered False 00:44:20.667769 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 00:44:21.906903 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:44:21.913379 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 00:44:21.934869 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 00:44:21.961871 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 00:44:22.016078 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 00:44:22.037660 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 00:44:22.064707 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 00:44:22.611165 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 00:44:22.661958 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:22.673174 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:44:22.734807 tst mo_mt_call.py: using LAC 17886 00:44:22.864152 tst mo_mt_call.py: using RAC 36 00:44:22.989425 tst mo_mt_call.py: using CellId 17886 00:44:23.110674 tst mo_mt_call.py: using BVCI 17887 00:44:23.225811 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:23.237147 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:23.248047 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:23.259598 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:23.270867 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:23.282245 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:44:23.404099 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:44:23.520076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:24.001877 run create_hlr_db(pid=3048): Launched 00:44:24.119087 bus /sierra_2: Setting Powered False 00:44:25.179819 run create_hlr_db(pid=3048): Terminated: ok {rc=0} 00:44:25.634805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3050): Launched 00:44:25.969175 run osmo-hlr_10.42.42.2(pid=3051): Launched 00:44:26.096489 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:26.672915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3053): Launched 00:44:27.007005 run osmo-stp_10.42.42.5(pid=3054): Launched 00:44:27.133619 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:27.736274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3056): Launched 00:44:28.071310 run osmo-msc_10.42.42.6(pid=3057): Launched 00:44:28.256507 run osmo-stp_10.42.42.5(pid=3054): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3054)] 00:44:28.395636 run osmo-stp_10.42.42.5(pid=3054): stdout: | (launched: 2022-12-09_00:44:26.944883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:28.535608 run osmo-stp_10.42.42.5(pid=3054): stderr: | 20221209004427140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004427140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004427140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004427141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004427141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004427141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004427141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:28.674837 run osmo-stp_10.42.42.5(pid=3054): stdout: | (launched: 2022-12-09_00:44:26.944883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:28.807103 run osmo-stp_10.42.42.5(pid=3054): stderr: | 20221209004427140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004427140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004427140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004427141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004427141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004427141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004427141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:28.965582 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3054): Process ended prematurely: osmo-stp_10.42.42.5(pid=3054) [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3054)] [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 00:44:28.975280 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:44:29.003810 run osmo-hlr_10.42.42.2(pid=3051): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3051)] 00:44:29.054459 run osmo-hlr_10.42.42.2(pid=3051): stdout: | (launched: 2022-12-09_00:44:25.906938) 00:44:29.106950 run osmo-hlr_10.42.42.2(pid=3051): stderr: | 20221209004426111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004426111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004426112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004426112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004426112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004426112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004426125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004426133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004426133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004426133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:29.179479 run osmo-msc_10.42.42.6(pid=3057): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3057)] 00:44:29.229640 run osmo-msc_10.42.42.6(pid=3057): stdout: | (launched: 2022-12-09_00:44:28.008447) 00:44:29.282033 run osmo-msc_10.42.42.6(pid=3057): stderr: | 20221209004428334 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004428334 DLGLOBAL DEBUG validating counter group 0x7f44a26fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004428334 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004428334 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004428335 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004428335 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004428337 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004428337 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004428337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004428337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:29.335051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3050): Terminating (SIGTERM) 00:44:29.377156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3053): Terminating (SIGTERM) 00:44:29.419161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3056): Terminating (SIGTERM) 00:44:29.461566 --- ParallelTerminationStrategy: PID 3050 died... 00:44:29.481616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3050): Terminated: ok {rc=0} 00:44:29.528260 --- ParallelTerminationStrategy: PID 3053 died... 00:44:29.547904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3053): Terminated: ok {rc=0} 00:44:29.594558 --- ParallelTerminationStrategy: PID 3056 died... 00:44:29.614064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3056): Terminated: ok {rc=0} 00:44:29.702215 bus /sierra_3: Setting Powered False 00:44:30.798741 bus /sierra_3: Setting Powered False 00:44:31.925971 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 00:44:33.092471 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:33.104934 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:44:33.163728 tst mo_mt_call_osmux.py: using LAC 17887 00:44:33.294025 tst mo_mt_call_osmux.py: using RAC 37 00:44:33.417986 tst mo_mt_call_osmux.py: using CellId 17887 00:44:33.541323 tst mo_mt_call_osmux.py: using BVCI 17888 00:44:33.653581 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:33.664648 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:33.675593 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:33.686730 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:33.697909 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:33.709173 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:44:33.828151 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:44:33.947207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:34.430909 run create_hlr_db(pid=3059): Launched 00:44:34.549454 bus /sierra_2: Setting Powered False 00:44:35.610937 run create_hlr_db(pid=3059): Terminated: ok {rc=0} 00:44:36.069115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3061): Launched 00:44:36.406743 run osmo-hlr_10.42.42.2(pid=3062): Launched 00:44:36.535237 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:37.112820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3064): Launched 00:44:37.448550 run osmo-stp_10.42.42.5(pid=3065): Launched 00:44:37.575483 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:38.180389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3067): Launched 00:44:38.517171 run osmo-msc_10.42.42.6(pid=3068): Launched 00:44:38.703686 run osmo-stp_10.42.42.5(pid=3065): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3065)] 00:44:38.844271 run osmo-stp_10.42.42.5(pid=3065): stdout: | (launched: 2022-12-09_00:44:37.386346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:38.985990 run osmo-stp_10.42.42.5(pid=3065): stderr: | 20221209004437583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004437583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004437583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004437584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004437584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004437584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004437584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:39.125566 run osmo-stp_10.42.42.5(pid=3065): stdout: | (launched: 2022-12-09_00:44:37.386346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:39.258727 run osmo-stp_10.42.42.5(pid=3065): stderr: | 20221209004437583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004437583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004437583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004437584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004437584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004437584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004437584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:39.417997 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3065): Process ended prematurely: osmo-stp_10.42.42.5(pid=3065) [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3065)] [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 00:44:39.427815 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 00:44:39.456165 run osmo-hlr_10.42.42.2(pid=3062): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3062)] 00:44:39.507037 run osmo-hlr_10.42.42.2(pid=3062): stdout: | (launched: 2022-12-09_00:44:36.344026) 00:44:39.559898 run osmo-hlr_10.42.42.2(pid=3062): stderr: | 20221209004436545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004436545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004436545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004436545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004436545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004436545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004436557 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004436566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004436566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004436567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:39.633345 run osmo-msc_10.42.42.6(pid=3068): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3068)] 00:44:39.684292 run osmo-msc_10.42.42.6(pid=3068): stdout: | (launched: 2022-12-09_00:44:38.454547) 00:44:39.737335 run osmo-msc_10.42.42.6(pid=3068): stderr: | 20221209004438779 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004438779 DLGLOBAL DEBUG validating counter group 0x7f0bc281bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004438779 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004438779 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004438780 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004438780 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004438782 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004438782 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004438782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004438782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:39.790347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3061): Terminating (SIGTERM) 00:44:39.832636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3064): Terminating (SIGTERM) 00:44:39.875345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3067): Terminating (SIGTERM) 00:44:39.918304 --- ParallelTerminationStrategy: PID 3061 died... 00:44:39.938647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3061): Terminated: ok {rc=0} 00:44:39.985874 --- ParallelTerminationStrategy: PID 3064 died... 00:44:40.006564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3064): Terminated: ok {rc=0} 00:44:40.053154 --- ParallelTerminationStrategy: PID 3067 died... 00:44:40.072713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3067): Terminated: ok {rc=0} 00:44:40.161782 bus /sierra_3: Setting Powered False 00:44:41.263231 bus /sierra_3: Setting Powered False 00:44:42.380895 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:44:43.625034 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:44:43.632196 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:44:43.654079 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:44:43.682077 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:44:43.733790 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:44:43.755115 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:44:43.782231 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:44:44.335532 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:44:44.389358 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:44.400996 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:44:44.457233 tst mo_mt_call.py: using LAC 17888 00:44:44.586066 tst mo_mt_call.py: using RAC 38 00:44:44.706930 tst mo_mt_call.py: using CellId 17888 00:44:44.829934 tst mo_mt_call.py: using BVCI 17889 00:44:44.943268 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:44.954718 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:44.965836 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:44.977475 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:44.988777 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:45.000195 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:45.116446 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:45.232850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:45.714433 run create_hlr_db(pid=3074): Launched 00:44:45.837124 bus /sierra_2: Setting Powered False 00:44:46.908500 run create_hlr_db(pid=3074): Terminated: ok {rc=0} 00:44:47.392561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3076): Launched 00:44:47.727763 run osmo-hlr_10.42.42.2(pid=3077): Launched 00:44:47.857865 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:48.403495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3079): Launched 00:44:48.716166 run osmo-stp_10.42.42.5(pid=3080): Launched 00:44:48.834816 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:49.396744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3082): Launched 00:44:49.708092 run osmo-msc_10.42.42.6(pid=3083): Launched 00:44:49.881425 run osmo-stp_10.42.42.5(pid=3080): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3080)] 00:44:50.012897 run osmo-stp_10.42.42.5(pid=3080): stdout: | (launched: 2022-12-09_00:44:48.657480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:50.144807 run osmo-stp_10.42.42.5(pid=3080): stderr: | 20221209004448831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004448831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004448832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004448832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004448832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004448833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004448833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:50.274443 run osmo-stp_10.42.42.5(pid=3080): stdout: | (launched: 2022-12-09_00:44:48.657480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:50.397897 run osmo-stp_10.42.42.5(pid=3080): stderr: | 20221209004448831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004448831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004448832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004448832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004448832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004448833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004448833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:50.546645 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3080): Process ended prematurely: osmo-stp_10.42.42.5(pid=3080) [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3080)] [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:44:50.555412 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:44:50.582756 run osmo-hlr_10.42.42.2(pid=3077): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3077)] 00:44:50.631353 run osmo-hlr_10.42.42.2(pid=3077): stdout: | (launched: 2022-12-09_00:44:47.665680) 00:44:50.681673 run osmo-hlr_10.42.42.2(pid=3077): stderr: | 20221209004447867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004447867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004447867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004447867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004447867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004447867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004447879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004447887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004447887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004447888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:50.751234 run osmo-msc_10.42.42.6(pid=3083): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3083)] 00:44:50.799514 run osmo-msc_10.42.42.6(pid=3083): stdout: | (launched: 2022-12-09_00:44:49.649610) 00:44:50.849553 run osmo-msc_10.42.42.6(pid=3083): stderr: | 20221209004449926 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004449926 DLGLOBAL DEBUG validating counter group 0x7f278af42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004449926 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004449926 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004449926 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004449927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004449928 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004449929 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004449929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004449929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:50.900176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3076): Terminating (SIGTERM) 00:44:50.940809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3079): Terminating (SIGTERM) 00:44:50.981702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3082): Terminating (SIGTERM) 00:44:51.022349 --- ParallelTerminationStrategy: PID 3076 died... 00:44:51.041748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3076): Terminated: ok {rc=0} 00:44:51.087101 --- ParallelTerminationStrategy: PID 3079 died... 00:44:51.106036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3079): Terminated: ok {rc=0} 00:44:51.150955 --- ParallelTerminationStrategy: PID 3082 died... 00:44:51.169946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3082): Terminated: ok {rc=0} 00:44:51.257209 bus /sierra_3: Setting Powered False 00:44:52.358809 bus /sierra_3: Setting Powered False 00:44:53.473412 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:44:54.624345 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:54.636675 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:44:54.696055 tst mo_mt_call_osmux.py: using LAC 17889 00:44:54.827743 tst mo_mt_call_osmux.py: using RAC 39 00:44:54.952046 tst mo_mt_call_osmux.py: using CellId 17889 00:44:55.075306 tst mo_mt_call_osmux.py: using BVCI 17890 00:44:55.190377 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:55.201722 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:55.212834 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:55.224079 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:55.235145 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:55.246329 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:55.362776 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:55.483523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:55.967258 run create_hlr_db(pid=3085): Launched 00:44:56.086899 bus /sierra_2: Setting Powered False 00:44:57.147910 run create_hlr_db(pid=3085): Terminated: ok {rc=0} 00:44:57.582774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3087): Launched 00:44:57.893981 run osmo-hlr_10.42.42.2(pid=3088): Launched 00:44:58.012433 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:58.564073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3090): Launched 00:44:58.899798 run osmo-stp_10.42.42.5(pid=3091): Launched 00:44:59.026755 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:59.631589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3093): Launched 00:44:59.965457 run osmo-msc_10.42.42.6(pid=3094): Launched 00:45:00.151439 run osmo-stp_10.42.42.5(pid=3091): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3091)] 00:45:00.291932 run osmo-stp_10.42.42.5(pid=3091): stdout: | (launched: 2022-12-09_00:44:58.837563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:00.432231 run osmo-stp_10.42.42.5(pid=3091): stderr: | 20221209004459033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004459033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004459033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004459034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004459034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004459034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004459034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:00.572286 run osmo-stp_10.42.42.5(pid=3091): stdout: | (launched: 2022-12-09_00:44:58.837563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:00.705304 run osmo-stp_10.42.42.5(pid=3091): stderr: | 20221209004459033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004459033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004459033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004459034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004459034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004459034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004459034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:00.886011 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3091): Process ended prematurely: osmo-stp_10.42.42.5(pid=3091) [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3091)] [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:45:00.896361 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:45:00.924889 run osmo-hlr_10.42.42.2(pid=3088): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3088)] 00:45:00.975967 run osmo-hlr_10.42.42.2(pid=3088): stdout: | (launched: 2022-12-09_00:44:57.835445) 00:45:01.028669 run osmo-hlr_10.42.42.2(pid=3088): stderr: | 20221209004458016 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004458016 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004458016 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004458016 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004458016 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004458016 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004458027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004458036 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004458036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004458036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:01.103653 run osmo-msc_10.42.42.6(pid=3094): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3094)] 00:45:01.167738 run osmo-msc_10.42.42.6(pid=3094): stdout: | (launched: 2022-12-09_00:44:59.903167) 00:45:01.221338 run osmo-msc_10.42.42.6(pid=3094): stderr: | 20221209004500230 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004500230 DLGLOBAL DEBUG validating counter group 0x7f3b1ceddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004500230 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004500230 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004500231 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004500231 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004500232 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004500233 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004500233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004500233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:01.277363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3087): Terminating (SIGTERM) 00:45:01.320496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3090): Terminating (SIGTERM) 00:45:01.365350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3093): Terminating (SIGTERM) 00:45:01.409594 --- ParallelTerminationStrategy: PID 3087 died... 00:45:01.429804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3087): Terminated: ok {rc=0} 00:45:01.482520 --- ParallelTerminationStrategy: PID 3090 died... 00:45:01.506416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3090): Terminated: ok {rc=0} 00:45:01.564279 --- ParallelTerminationStrategy: PID 3093 died... 00:45:01.588595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3093): Terminated: ok {rc=0} 00:45:01.690080 bus /sierra_3: Setting Powered False 00:45:02.789817 bus /sierra_3: Setting Powered False 00:45:03.905739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:45:05.146889 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:45:05.154474 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:45:05.176509 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:45:05.203973 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:45:05.257724 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:45:05.279616 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:45:05.306875 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:45:05.858751 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:45:05.911723 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:05.923429 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:45:05.981825 tst mo_mt_call.py: using LAC 17890 00:45:06.105691 tst mo_mt_call.py: using RAC 40 00:45:06.228018 tst mo_mt_call.py: using CellId 17890 00:45:06.351272 tst mo_mt_call.py: using BVCI 17891 00:45:06.464027 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:06.475403 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:06.486506 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:06.497737 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:06.508856 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:06.520081 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:45:06.640780 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:45:06.759664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:07.243029 run create_hlr_db(pid=3102): Launched 00:45:07.360244 bus /sierra_2: Setting Powered False 00:45:08.421928 run create_hlr_db(pid=3102): Terminated: ok {rc=0} 00:45:08.880482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3104): Launched 00:45:09.215446 run osmo-hlr_10.42.42.2(pid=3105): Launched 00:45:09.343554 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:09.922162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3107): Launched 00:45:10.256639 run osmo-stp_10.42.42.5(pid=3108): Launched 00:45:10.384689 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:10.989639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3110): Launched 00:45:11.325624 run osmo-msc_10.42.42.6(pid=3111): Launched 00:45:11.515605 run osmo-stp_10.42.42.5(pid=3108): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3108)] 00:45:11.656181 run osmo-stp_10.42.42.5(pid=3108): stdout: | (launched: 2022-12-09_00:45:10.194131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:11.797184 run osmo-stp_10.42.42.5(pid=3108): stderr: | 20221209004510388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004510388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004510388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004510389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004510391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004510391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004510391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:11.936910 run osmo-stp_10.42.42.5(pid=3108): stdout: | (launched: 2022-12-09_00:45:10.194131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:12.069919 run osmo-stp_10.42.42.5(pid=3108): stderr: | 20221209004510388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004510388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004510388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004510389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004510391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004510391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004510391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:12.229261 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3108): Process ended prematurely: osmo-stp_10.42.42.5(pid=3108) [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3108)] [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:45:12.238774 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:45:12.266759 run osmo-hlr_10.42.42.2(pid=3105): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3105)] 00:45:12.317673 run osmo-hlr_10.42.42.2(pid=3105): stdout: | (launched: 2022-12-09_00:45:09.153183) 00:45:12.370501 run osmo-hlr_10.42.42.2(pid=3105): stderr: | 20221209004509356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004509356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004509356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004509356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004509356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004509356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004509368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004509377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004509377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004509378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:12.443484 run osmo-msc_10.42.42.6(pid=3111): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3111)] 00:45:12.494105 run osmo-msc_10.42.42.6(pid=3111): stdout: | (launched: 2022-12-09_00:45:11.262611) 00:45:12.546449 run osmo-msc_10.42.42.6(pid=3111): stderr: | 20221209004511589 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004511590 DLGLOBAL DEBUG validating counter group 0x7f26dd2ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004511590 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004511590 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004511590 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004511590 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004511592 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004511592 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004511592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004511592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:12.599458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3104): Terminating (SIGTERM) 00:45:12.641675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3107): Terminating (SIGTERM) 00:45:12.683861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3110): Terminating (SIGTERM) 00:45:12.726338 --- ParallelTerminationStrategy: PID 3104 died... 00:45:12.746603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3104): Terminated: ok {rc=0} 00:45:12.793237 --- ParallelTerminationStrategy: PID 3107 died... 00:45:12.812791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3107): Terminated: ok {rc=0} 00:45:12.859744 --- ParallelTerminationStrategy: PID 3110 died... 00:45:12.879500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3110): Terminated: ok {rc=0} 00:45:12.968413 bus /sierra_3: Setting Powered False 00:45:14.068547 bus /sierra_3: Setting Powered False 00:45:15.188028 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:45:16.364223 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:16.377226 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:45:16.440404 tst mo_mt_call_osmux.py: using LAC 17891 00:45:16.617193 tst mo_mt_call_osmux.py: using RAC 41 00:45:16.742478 tst mo_mt_call_osmux.py: using CellId 17891 00:45:16.868371 tst mo_mt_call_osmux.py: using BVCI 17892 00:45:16.986876 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:16.999330 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:17.011498 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:17.025744 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:17.040073 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:17.053500 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:45:17.172662 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:45:17.294910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:17.779636 run create_hlr_db(pid=3113): Launched 00:45:17.898795 bus /sierra_2: Setting Powered False 00:45:18.959942 run create_hlr_db(pid=3113): Terminated: ok {rc=0} 00:45:19.393598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3115): Launched 00:45:19.708188 run osmo-hlr_10.42.42.2(pid=3116): Launched 00:45:19.827130 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:20.366183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3118): Launched 00:45:20.678625 run osmo-stp_10.42.42.5(pid=3119): Launched 00:45:20.797897 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:21.360799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3121): Launched 00:45:21.672708 run osmo-msc_10.42.42.6(pid=3122): Launched 00:45:21.845942 run osmo-stp_10.42.42.5(pid=3119): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3119)] 00:45:22.031468 run osmo-stp_10.42.42.5(pid=3119): stdout: | (launched: 2022-12-09_00:45:20.618993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:22.160726 run osmo-stp_10.42.42.5(pid=3119): stderr: | 20221209004520793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004520793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004520793 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004520794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004520794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004520794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004520794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:22.289703 run osmo-stp_10.42.42.5(pid=3119): stdout: | (launched: 2022-12-09_00:45:20.618993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:22.412562 run osmo-stp_10.42.42.5(pid=3119): stderr: | 20221209004520793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004520793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004520793 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004520794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004520794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004520794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004520794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:22.560403 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3119): Process ended prematurely: osmo-stp_10.42.42.5(pid=3119) [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3119)] [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:45:22.569436 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:45:22.596567 run osmo-hlr_10.42.42.2(pid=3116): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3116)] 00:45:22.645054 run osmo-hlr_10.42.42.2(pid=3116): stdout: | (launched: 2022-12-09_00:45:19.648590) 00:45:22.695558 run osmo-hlr_10.42.42.2(pid=3116): stderr: | 20221209004519828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004519828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004519828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004519828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004519828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004519828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004519841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004519850 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004519850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004519850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:22.765589 run osmo-msc_10.42.42.6(pid=3122): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3122)] 00:45:22.814164 run osmo-msc_10.42.42.6(pid=3122): stdout: | (launched: 2022-12-09_00:45:21.614084) 00:45:22.864494 run osmo-msc_10.42.42.6(pid=3122): stderr: | 20221209004521891 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004521891 DLGLOBAL DEBUG validating counter group 0x7f7aef26dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004521891 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004521891 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004521891 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004521891 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004521893 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004521894 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004521894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004521894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:22.915203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3115): Terminating (SIGTERM) 00:45:22.955440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3118): Terminating (SIGTERM) 00:45:22.995711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3121): Terminating (SIGTERM) 00:45:23.036149 --- ParallelTerminationStrategy: PID 3115 died... 00:45:23.055407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3115): Terminated: ok {rc=0} 00:45:23.100113 --- ParallelTerminationStrategy: PID 3118 died... 00:45:23.118802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3118): Terminated: ok {rc=0} 00:45:23.163265 --- ParallelTerminationStrategy: PID 3121 died... 00:45:23.181804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3121): Terminated: ok {rc=0} 00:45:23.269471 bus /sierra_3: Setting Powered False 00:45:24.370678 bus /sierra_3: Setting Powered False 00:45:25.487929 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:45:26.734366 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:45:26.740572 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:45:26.762523 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 00:45:26.790506 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 00:45:26.842220 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:45:26.863515 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 00:45:26.890599 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 00:45:27.443313 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 00:45:27.496215 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:27.507730 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:45:27.564939 tst mo_mt_call.py: using LAC 17892 00:45:27.694173 tst mo_mt_call.py: using RAC 42 00:45:27.822317 tst mo_mt_call.py: using CellId 17892 00:45:27.952312 tst mo_mt_call.py: using BVCI 17893 00:45:28.074821 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:28.086326 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:28.097602 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:28.108877 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:28.120162 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:28.131442 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:28.247324 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:28.364835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:28.847365 run create_hlr_db(pid=3127): Launched 00:45:28.972358 bus /sierra_2: Setting Powered False 00:45:30.034199 run create_hlr_db(pid=3127): Terminated: ok {rc=0} 00:45:30.491475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3129): Launched 00:45:30.834056 run osmo-hlr_10.42.42.2(pid=3130): Launched 00:45:31.121128 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:31.773113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3132): Launched 00:45:32.119537 run osmo-stp_10.42.42.5(pid=3133): Launched 00:45:32.292920 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:32.859247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3135): Launched 00:45:33.172216 run osmo-msc_10.42.42.6(pid=3136): Launched 00:45:33.346100 run osmo-stp_10.42.42.5(pid=3133): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3133)] 00:45:33.478297 run osmo-stp_10.42.42.5(pid=3133): stdout: | (launched: 2022-12-09_00:45:32.054326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:33.609599 run osmo-stp_10.42.42.5(pid=3133): stderr: | 20221209004532270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004532270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004532271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004532271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004532272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004532272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004532272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:33.738754 run osmo-stp_10.42.42.5(pid=3133): stdout: | (launched: 2022-12-09_00:45:32.054326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:33.862025 run osmo-stp_10.42.42.5(pid=3133): stderr: | 20221209004532270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004532270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004532271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004532271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004532272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004532272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004532272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:34.009863 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3133): Process ended prematurely: osmo-stp_10.42.42.5(pid=3133) [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3133)] [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 00:45:34.018678 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 00:45:34.045631 run osmo-hlr_10.42.42.2(pid=3130): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3130)] 00:45:34.094236 run osmo-hlr_10.42.42.2(pid=3130): stdout: | (launched: 2022-12-09_00:45:30.764530) 00:45:34.144519 run osmo-hlr_10.42.42.2(pid=3130): stderr: | 20221209004531055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004531055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004531055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004531056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004531057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004531057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004531075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004531092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004531092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004531092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:34.214341 run osmo-msc_10.42.42.6(pid=3136): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3136)] 00:45:34.262803 run osmo-msc_10.42.42.6(pid=3136): stdout: | (launched: 2022-12-09_00:45:33.113203) 00:45:34.313505 run osmo-msc_10.42.42.6(pid=3136): stderr: | 20221209004533387 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004533388 DLGLOBAL DEBUG validating counter group 0x7f4e8e28bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004533388 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004533388 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004533388 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004533388 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004533392 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004533392 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004533392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004533392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:34.364167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3129): Terminating (SIGTERM) 00:45:34.404598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3132): Terminating (SIGTERM) 00:45:34.445179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3135): Terminating (SIGTERM) 00:45:34.486127 --- ParallelTerminationStrategy: PID 3129 died... 00:45:34.505568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3129): Terminated: ok {rc=0} 00:45:34.550668 --- ParallelTerminationStrategy: PID 3132 died... 00:45:34.569486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3132): Terminated: ok {rc=0} 00:45:34.614614 --- ParallelTerminationStrategy: PID 3135 died... 00:45:34.633488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3135): Terminated: ok {rc=0} 00:45:34.720805 bus /sierra_3: Setting Powered False 00:45:35.821882 bus /sierra_3: Setting Powered False 00:45:36.940408 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 00:45:38.089508 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:38.101228 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:45:38.159799 tst mo_mt_call_osmux.py: using LAC 17893 00:45:38.282859 tst mo_mt_call_osmux.py: using RAC 43 00:45:38.410038 tst mo_mt_call_osmux.py: using CellId 17893 00:45:38.533227 tst mo_mt_call_osmux.py: using BVCI 17894 00:45:38.655935 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:38.667629 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:38.679017 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:38.690643 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:38.702051 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:38.713464 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:38.836153 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:38.953691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:39.473584 run create_hlr_db(pid=3138): Launched 00:45:39.608141 bus /sierra_2: Setting Powered False 00:45:40.673964 run create_hlr_db(pid=3138): Terminated: ok {rc=0} 00:45:41.119209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3140): Launched 00:45:41.431461 run osmo-hlr_10.42.42.2(pid=3141): Launched 00:45:41.549733 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:42.085280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3143): Launched 00:45:42.397493 run osmo-stp_10.42.42.5(pid=3144): Launched 00:45:42.515694 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:43.081253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3146): Launched 00:45:43.393283 run osmo-msc_10.42.42.6(pid=3147): Launched 00:45:43.566806 run osmo-stp_10.42.42.5(pid=3144): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3144)] 00:45:43.697797 run osmo-stp_10.42.42.5(pid=3144): stdout: | (launched: 2022-12-09_00:45:42.338313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:43.828413 run osmo-stp_10.42.42.5(pid=3144): stderr: | 20221209004542513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004542513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004542513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004542514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004542514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004542514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004542514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:43.956903 run osmo-stp_10.42.42.5(pid=3144): stdout: | (launched: 2022-12-09_00:45:42.338313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:44.079754 run osmo-stp_10.42.42.5(pid=3144): stderr: | 20221209004542513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004542513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004542513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004542514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004542514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004542514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004542514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:44.226792 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3144): Process ended prematurely: osmo-stp_10.42.42.5(pid=3144) [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3144)] [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 00:45:44.235711 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:45:44.262580 run osmo-hlr_10.42.42.2(pid=3141): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3141)] 00:45:44.311364 run osmo-hlr_10.42.42.2(pid=3141): stdout: | (launched: 2022-12-09_00:45:41.372491) 00:45:44.361364 run osmo-hlr_10.42.42.2(pid=3141): stderr: | 20221209004541554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004541554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004541554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004541554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004541554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004541554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004541569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004541578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004541578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004541578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:44.431117 run osmo-msc_10.42.42.6(pid=3147): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3147)] 00:45:44.479395 run osmo-msc_10.42.42.6(pid=3147): stdout: | (launched: 2022-12-09_00:45:43.334470) 00:45:44.529339 run osmo-msc_10.42.42.6(pid=3147): stderr: | 20221209004543610 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004543610 DLGLOBAL DEBUG validating counter group 0x7ff6c3d67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004543610 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004543610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004543611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004543611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004543612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004543613 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004543613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004543613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:44.579630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3140): Terminating (SIGTERM) 00:45:44.619588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3143): Terminating (SIGTERM) 00:45:44.659582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3146): Terminating (SIGTERM) 00:45:44.699845 --- ParallelTerminationStrategy: PID 3140 died... 00:45:44.718897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3140): Terminated: ok {rc=0} 00:45:44.763085 --- ParallelTerminationStrategy: PID 3143 died... 00:45:44.781756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3143): Terminated: ok {rc=0} 00:45:44.826510 --- ParallelTerminationStrategy: PID 3146 died... 00:45:44.845348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3146): Terminated: ok {rc=0} 00:45:44.932344 bus /sierra_3: Setting Powered False 00:45:46.036778 bus /sierra_3: Setting Powered False 00:45:47.156137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 emergency:sysmo --------------------------------------------------------------------- 00:45:48.397109 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:45:48.401728 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 00:45:48.423420 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 00:45:48.450953 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 00:45:48.537979 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 00:45:48.559504 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 00:45:48.587053 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 00:45:49.171484 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2352 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 00:45:49.176595 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:49.187775 tst emergency:sysmo: Using 1 x bts (candidates: 1) 00:45:49.225324 tst emergency_mo_mt_call.py: using LAC 17894 00:45:49.355024 tst emergency_mo_mt_call.py: using RAC 44 00:45:49.485281 tst emergency_mo_mt_call.py: using CellId 17894 00:45:49.613461 tst emergency_mo_mt_call.py: using BVCI 17895 00:45:49.732224 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:49.743483 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:49.754575 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:49.765631 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:49.776622 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:49.787598 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:49.903217 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:50.023864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:50.535607 run create_hlr_db(pid=3152): Launched 00:45:50.668686 bus /sierra_2: Setting Powered False 00:45:51.733480 run create_hlr_db(pid=3152): Terminated: ok {rc=0} 00:45:52.193359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3154): Launched 00:45:52.524641 run osmo-hlr_10.42.42.2(pid=3155): Launched 00:45:52.650214 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:53.221211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3157): Launched 00:45:53.551496 run osmo-stp_10.42.42.5(pid=3158): Launched 00:45:53.686766 tst emergency_mo_mt_call.py: using MSISDN 6942 00:45:53.854213 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:54.445505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3160): Launched 00:45:54.775330 run osmo-msc_10.42.42.6(pid=3161): Launched 00:45:54.957924 run osmo-stp_10.42.42.5(pid=3158): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3158)] 00:45:55.095380 run osmo-stp_10.42.42.5(pid=3158): stdout: | (launched: 2022-12-09_00:45:53.489705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:55.233595 run osmo-stp_10.42.42.5(pid=3158): stderr: | 20221209004553685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004553685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004553686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004553686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004553688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004553688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004553688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:55.371293 run osmo-stp_10.42.42.5(pid=3158): stdout: | (launched: 2022-12-09_00:45:53.489705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:55.501143 run osmo-stp_10.42.42.5(pid=3158): stderr: | 20221209004553685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004553685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004553686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004553686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004553688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004553688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004553688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:55.656593 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=3158): Process ended prematurely: osmo-stp_10.42.42.5(pid=3158) [trial-2352↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3158)] [trial-2352↪emergency:sysmo↪emergency_mo_mt_call.py:19] 00:45:55.665612 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 00:45:55.693251 run osmo-hlr_10.42.42.2(pid=3155): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3155)] 00:45:55.743864 run osmo-hlr_10.42.42.2(pid=3155): stdout: | (launched: 2022-12-09_00:45:52.462932) 00:45:55.796216 run osmo-hlr_10.42.42.2(pid=3155): stderr: | 20221209004552666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004552666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004552666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004552666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004552666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004552666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004552678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004552687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004552687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004552687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:55.869212 run osmo-msc_10.42.42.6(pid=3161): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3161)] 00:45:55.919961 run osmo-msc_10.42.42.6(pid=3161): stdout: | (launched: 2022-12-09_00:45:54.713505) 00:45:55.972426 run osmo-msc_10.42.42.6(pid=3161): stderr: | 20221209004555040 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004555041 DLGLOBAL DEBUG validating counter group 0x7f4c7b1b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004555041 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004555041 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004555041 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004555041 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004555043 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004555043 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004555043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004555044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:56.025357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3154): Terminating (SIGTERM) 00:45:56.067662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3157): Terminating (SIGTERM) 00:45:56.110007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3160): Terminating (SIGTERM) 00:45:56.152481 --- ParallelTerminationStrategy: PID 3154 died... 00:45:56.172743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3154): Terminated: ok {rc=0} 00:45:56.219436 --- ParallelTerminationStrategy: PID 3157 died... 00:45:56.239299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3157): Terminated: ok {rc=0} 00:45:56.285947 --- ParallelTerminationStrategy: PID 3160 died... 00:45:56.305940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3160): Terminated: ok {rc=0} 00:45:56.394681 bus /sierra_3: Setting Powered False 00:45:57.495965 bus /sierra_3: Setting Powered False 00:45:58.613372 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 00:45:59.699360 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:59.711396 tst emergency:sysmo: Using 1 x bts (candidates: 1) 00:45:59.749358 tst emergency_preemptive_call.py: using LAC 17895 00:45:59.872008 tst emergency_preemptive_call.py: using RAC 45 00:45:59.993383 tst emergency_preemptive_call.py: using CellId 17895 00:46:00.112123 tst emergency_preemptive_call.py: using BVCI 17896 00:46:00.224341 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:46:00.234950 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:46:00.245438 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:46:00.256187 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:46:00.266864 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:46:00.277478 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:46:00.396515 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:46:00.516909 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:46:00.633268 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:46:00.746916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:01.367444 run create_hlr_db(pid=3163): Launched 00:46:01.550222 bus /sierra_2: Setting Powered False 00:46:02.615848 run create_hlr_db(pid=3163): Terminated: ok {rc=0} 00:46:03.126867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3165): Launched 00:46:03.458011 run osmo-hlr_10.42.42.2(pid=3166): Launched 00:46:03.583273 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:04.153551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3168): Launched 00:46:04.483861 run osmo-stp_10.42.42.5(pid=3169): Launched 00:46:04.618734 tst emergency_preemptive_call.py: using MSISDN 6943 00:46:04.788324 run osmo-msc_10.42.42.6: Starting osmo-msc 00:46:05.380262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3171): Launched 00:46:05.711793 run osmo-msc_10.42.42.6(pid=3172): Launched 00:46:05.900626 run osmo-stp_10.42.42.5(pid=3169): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3169)] 00:46:06.038348 run osmo-stp_10.42.42.5(pid=3169): stdout: | (launched: 2022-12-09_00:46:04.422305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:06.176279 run osmo-stp_10.42.42.5(pid=3169): stderr: | 20221209004604617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004604617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004604617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004604617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004604620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004604620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004604620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:06.313828 run osmo-stp_10.42.42.5(pid=3169): stdout: | (launched: 2022-12-09_00:46:04.422305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:06.444515 run osmo-stp_10.42.42.5(pid=3169): stderr: | 20221209004604617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004604617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004604617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004604617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004604620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004604620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004604620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:06.600496 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=3169): Process ended prematurely: osmo-stp_10.42.42.5(pid=3169) [trial-2352↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3169)] [trial-2352↪emergency:sysmo↪emergency_preemptive_call.py:32] 00:46:06.609532 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 00:46:06.637015 run osmo-hlr_10.42.42.2(pid=3166): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3166)] 00:46:06.687324 run osmo-hlr_10.42.42.2(pid=3166): stdout: | (launched: 2022-12-09_00:46:03.396071) 00:46:06.739277 run osmo-hlr_10.42.42.2(pid=3166): stderr: | 20221209004603600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004603600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004603600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004603600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004603600 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004603600 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004603613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004603621 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004603621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004603621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:06.811481 run osmo-msc_10.42.42.6(pid=3172): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3172)] 00:46:06.861430 run osmo-msc_10.42.42.6(pid=3172): stdout: | (launched: 2022-12-09_00:46:05.649966) 00:46:06.913211 run osmo-msc_10.42.42.6(pid=3172): stderr: | 20221209004605978 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209004605978 DLGLOBAL DEBUG validating counter group 0x7fdd59adcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209004605978 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209004605978 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209004605978 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209004605979 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209004605980 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209004605981 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209004605981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209004605981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:46:06.965280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3165): Terminating (SIGTERM) 00:46:07.006848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3168): Terminating (SIGTERM) 00:46:07.048905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3171): Terminating (SIGTERM) 00:46:07.091108 --- ParallelTerminationStrategy: PID 3165 died... 00:46:07.110924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3165): Terminated: ok {rc=0} 00:46:07.157298 --- ParallelTerminationStrategy: PID 3168 died... 00:46:07.177009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3168): Terminated: ok {rc=0} 00:46:07.223601 --- ParallelTerminationStrategy: PID 3171 died... 00:46:07.243464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3171): Terminated: ok {rc=0} 00:46:07.331729 bus /sierra_9: Setting Powered False 00:46:08.430849 bus /sierra_9: Setting Powered False 00:46:09.547570 bus /sierra_8: Setting Powered False 00:46:10.647561 bus /sierra_8: Setting Powered False 00:46:11.760914 bus /sierra_3: Setting Powered False 00:46:12.860860 bus /sierra_3: Setting Powered False 00:46:13.978083 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:sysmo --------------------------------------------------------------------- 00:46:15.234280 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:46:15.239418 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 00:46:15.261452 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 00:46:15.301393 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 00:46:15.396059 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 00:46:15.417627 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 00:46:15.456909 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 00:46:16.073453 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 00:46:16.146032 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:16.161020 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:16.202783 tst cs_paging_gprs_active.py: using LAC 17896 00:46:16.364523 tst cs_paging_gprs_active.py: using RAC 46 00:46:16.522721 tst cs_paging_gprs_active.py: using CellId 17896 00:46:16.687650 tst cs_paging_gprs_active.py: using BVCI 17897 00:46:16.807321 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:16.819180 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:16.830959 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:16.847600 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:16.859607 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:16.871070 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:16.885792 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:16.897471 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:16.909960 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:17.053382 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:17.196864 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:46:17.411931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:17.728220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3177): Launched 00:46:18.001893 run iperf3-srv_10.42.42.10(pid=3178): Launched 00:46:18.118761 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:46:18.328028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:18.642742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3179): Launched 00:46:18.915821 run iperf3-srv_10.42.42.10(pid=3180): Launched 00:46:19.032526 tst cs_paging_gprs_active.py:38: start network... 00:46:19.240801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:19.723691 run create_hlr_db(pid=3181): Launched 00:46:19.841939 bus /sierra_2: Setting Powered False 00:46:20.903191 run create_hlr_db(pid=3181): Terminated: ok {rc=0} 00:46:21.338497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3183): Launched 00:46:21.651915 run osmo-hlr_10.42.42.2(pid=3184): Launched 00:46:21.771148 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:22.327362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3186): Launched 00:46:22.639486 run osmo-stp_10.42.42.5(pid=3187): Launched 00:46:22.757877 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:24.276261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3189): Launched 00:46:24.396388 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:24.661879 run patchelf(pid=3190): Launched 00:46:24.835702 run osmo-stp_10.42.42.5(pid=3187): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3187)] 00:46:24.968030 run osmo-stp_10.42.42.5(pid=3187): stdout: | (launched: 2022-12-09_00:46:22.580502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:25.102564 run osmo-stp_10.42.42.5(pid=3187): stderr: | 20221209004622754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004622754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004622755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004622755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004622755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004622756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004622756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:25.237115 run osmo-stp_10.42.42.5(pid=3187): stdout: | (launched: 2022-12-09_00:46:22.580502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:25.364893 run osmo-stp_10.42.42.5(pid=3187): stderr: | 20221209004622754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004622754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004622755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004622755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004622755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004622756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004622756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:25.516042 run patchelf(pid=3190): Terminating (SIGINT) 00:46:25.691517 run patchelf(pid=3190): Terminated: ok {rc=0} 00:46:25.818109 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3187): Process ended prematurely: osmo-stp_10.42.42.5(pid=3187) [trial-2352↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3187)] [trial-2352↪gprs:sysmo↪cs_paging_gprs_active.py:38] 00:46:25.827547 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 00:46:25.855538 run osmo-hlr_10.42.42.2(pid=3184): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3184)] 00:46:25.904356 run osmo-hlr_10.42.42.2(pid=3184): stdout: | (launched: 2022-12-09_00:46:21.593261) 00:46:25.954446 run osmo-hlr_10.42.42.2(pid=3184): stderr: | 20221209004621773 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004621773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004621773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004621773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004621773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004621774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004621786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004621794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004621794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004621795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:26.004749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3177): Terminating (SIGTERM) 00:46:26.045358 run iperf3-srv_10.42.42.10(pid=3178): Terminating (SIGTERM) 00:46:26.085862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3179): Terminating (SIGTERM) 00:46:26.126340 run iperf3-srv_10.42.42.10(pid=3180): Terminating (SIGTERM) 00:46:26.166558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3183): Terminating (SIGTERM) 00:46:26.206767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3186): Terminating (SIGTERM) 00:46:26.247136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3189): Terminating (SIGTERM) 00:46:26.287711 --- ParallelTerminationStrategy: PID 3177 died... 00:46:26.306988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3177): Terminated: ok {rc=0} 00:46:26.352285 --- ParallelTerminationStrategy: PID 3178 died... 00:46:26.371133 run iperf3-srv_10.42.42.10(pid=3178): Terminated {rc=256} 00:46:26.416113 --- ParallelTerminationStrategy: PID 3179 died... 00:46:26.435047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3179): Terminated: ok {rc=0} 00:46:26.480116 --- ParallelTerminationStrategy: PID 3180 died... 00:46:26.498931 run iperf3-srv_10.42.42.10(pid=3180): Terminated {rc=256} 00:46:26.543662 --- ParallelTerminationStrategy: PID 3183 died... 00:46:26.562509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3183): Terminated: ok {rc=0} 00:46:26.607870 --- ParallelTerminationStrategy: PID 3186 died... 00:46:26.626617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3186): Terminated: ok {rc=0} 00:46:26.671623 --- ParallelTerminationStrategy: PID 3189 died... 00:46:26.690870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3189): Terminated: ok {rc=0} 00:46:26.775890 bus /gobi_0: Setting Powered False 00:46:27.875635 bus /gobi_0: Setting Powered False 00:46:28.996618 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo iperf3.py ---------------------------------------------- 00:46:30.146796 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:30.158168 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:30.194617 tst iperf3.py: using LAC 17897 00:46:30.317817 tst iperf3.py: using RAC 47 00:46:30.450941 tst iperf3.py: using CellId 17897 00:46:30.582808 tst iperf3.py: using BVCI 17898 00:46:30.706326 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:30.717481 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:30.728358 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:30.739310 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:30.750134 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:30.761000 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:30.771988 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:30.783441 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:30.794546 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:30.951738 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:46:31.170234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:31.517290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3191): Launched 00:46:31.835841 run iperf3-srv_10.42.42.10(pid=3192): Launched 00:46:32.013488 tst iperf3.py:8: start network... 00:46:32.228159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:32.714763 run create_hlr_db(pid=3193): Launched 00:46:32.834760 bus /gobi_6: Setting Powered False 00:46:33.896394 run create_hlr_db(pid=3193): Terminated: ok {rc=0} 00:46:34.352855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3195): Launched 00:46:34.688397 run osmo-hlr_10.42.42.2(pid=3196): Launched 00:46:34.814995 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:35.392622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3198): Launched 00:46:35.727091 run osmo-stp_10.42.42.5(pid=3199): Launched 00:46:35.853255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:36.432073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3201): Launched 00:46:36.560085 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:36.844469 run patchelf(pid=3202): Launched 00:46:37.029557 run osmo-stp_10.42.42.5(pid=3199): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3199)] 00:46:37.170543 run osmo-stp_10.42.42.5(pid=3199): stdout: | (launched: 2022-12-09_00:46:35.664144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:37.313439 run osmo-stp_10.42.42.5(pid=3199): stderr: | 20221209004635862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004635862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004635862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004635863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004635863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004635863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004635863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:37.456685 run osmo-stp_10.42.42.5(pid=3199): stdout: | (launched: 2022-12-09_00:46:35.664144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:37.592849 run osmo-stp_10.42.42.5(pid=3199): stderr: | 20221209004635862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004635862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004635862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004635863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004635863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004635863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004635863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:37.754605 run patchelf(pid=3202): Terminating (SIGINT) 00:46:37.941447 run patchelf(pid=3202): Terminated: ok {rc=0} 00:46:38.076412 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3199): Process ended prematurely: osmo-stp_10.42.42.5(pid=3199) [trial-2352↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3199)] [trial-2352↪gprs:sysmo↪iperf3.py:8] 00:46:38.086816 tst iperf3.py:8: Test FAILED (8.0 sec) 00:46:38.115594 run osmo-hlr_10.42.42.2(pid=3196): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3196)] 00:46:38.165979 run osmo-hlr_10.42.42.2(pid=3196): stdout: | (launched: 2022-12-09_00:46:34.625949) 00:46:38.218009 run osmo-hlr_10.42.42.2(pid=3196): stderr: | 20221209004634826 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004634826 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004634826 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004634826 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004634826 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004634826 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004634842 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004634852 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004634852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004634852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:38.270564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3191): Terminating (SIGTERM) 00:46:38.312604 run iperf3-srv_10.42.42.10(pid=3192): Terminating (SIGTERM) 00:46:38.354994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3195): Terminating (SIGTERM) 00:46:38.397685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3198): Terminating (SIGTERM) 00:46:38.439810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3201): Terminating (SIGTERM) 00:46:38.482769 --- ParallelTerminationStrategy: PID 3191 died... 00:46:38.502968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3191): Terminated: ok {rc=0} 00:46:38.549630 --- ParallelTerminationStrategy: PID 3192 died... 00:46:38.569523 run iperf3-srv_10.42.42.10(pid=3192): Terminated {rc=256} 00:46:38.616045 --- ParallelTerminationStrategy: PID 3195 died... 00:46:38.635801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3195): Terminated: ok {rc=0} 00:46:38.682691 --- ParallelTerminationStrategy: PID 3198 died... 00:46:38.702586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3198): Terminated: ok {rc=0} 00:46:38.749327 --- ParallelTerminationStrategy: PID 3201 died... 00:46:38.769298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3201): Terminated: ok {rc=0} 00:46:38.858143 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo iperf3m4.py ---------------------------------------------- 00:46:40.012726 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:40.024789 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:40.061549 tst iperf3m4.py: using LAC 17898 00:46:40.193046 tst iperf3m4.py: using RAC 48 00:46:40.327088 tst iperf3m4.py: using CellId 17898 00:46:40.458440 tst iperf3m4.py: using BVCI 17899 00:46:40.581801 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:40.592786 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:40.603870 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:40.615435 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:40.626800 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:40.638235 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:40.649856 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:40.661280 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:40.672901 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:40.795151 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:40.920193 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:41.042784 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:41.161495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:46:41.371994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:41.687236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3203): Launched 00:46:41.960008 run iperf3-srv_10.42.42.10(pid=3204): Launched 00:46:42.077228 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:46:42.286295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:42.601433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3205): Launched 00:46:42.875750 run iperf3-srv_10.42.42.10(pid=3206): Launched 00:46:42.992543 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:46:43.201802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:43.517644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3207): Launched 00:46:43.790967 run iperf3-srv_10.42.42.10(pid=3208): Launched 00:46:43.907629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:46:44.116475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:44.430347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3209): Launched 00:46:44.719021 run iperf3-srv_10.42.42.10(pid=3210): Launched 00:46:44.835764 tst iperf3m4.py:8: start network... 00:46:45.044552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:45.531252 run create_hlr_db(pid=3211): Launched 00:46:45.649254 bus /gobi_6: Setting Powered False 00:46:46.709798 run create_hlr_db(pid=3211): Terminated: ok {rc=0} 00:46:47.160796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3213): Launched 00:46:47.475698 run osmo-hlr_10.42.42.2(pid=3214): Launched 00:46:47.595526 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:48.143857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3216): Launched 00:46:48.456226 run osmo-stp_10.42.42.5(pid=3217): Launched 00:46:48.574601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:49.111983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3219): Launched 00:46:49.231131 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:49.496639 run patchelf(pid=3220): Launched 00:46:49.669713 run osmo-stp_10.42.42.5(pid=3217): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3217)] 00:46:49.802006 run osmo-stp_10.42.42.5(pid=3217): stdout: | (launched: 2022-12-09_00:46:48.397353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:49.935825 run osmo-stp_10.42.42.5(pid=3217): stderr: | 20221209004648571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004648571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004648571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004648572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004648572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004648572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004648572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:50.069468 run osmo-stp_10.42.42.5(pid=3217): stdout: | (launched: 2022-12-09_00:46:48.397353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:50.198499 run osmo-stp_10.42.42.5(pid=3217): stderr: | 20221209004648571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004648571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004648571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004648572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004648572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004648572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004648572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:50.349360 run patchelf(pid=3220): Terminating (SIGINT) 00:46:50.524437 run patchelf(pid=3220): Terminated: ok {rc=0} 00:46:50.650794 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3217): Process ended prematurely: osmo-stp_10.42.42.5(pid=3217) [trial-2352↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3217)] [trial-2352↪gprs:sysmo↪iperf3m4.py:8] 00:46:50.660142 tst iperf3m4.py:8: Test FAILED (10.7 sec) 00:46:50.688074 run osmo-hlr_10.42.42.2(pid=3214): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3214)] 00:46:50.736562 run osmo-hlr_10.42.42.2(pid=3214): stdout: | (launched: 2022-12-09_00:46:47.416614) 00:46:50.786704 run osmo-hlr_10.42.42.2(pid=3214): stderr: | 20221209004647595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004647595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004647595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004647595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004647595 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004647595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004647607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004647617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004647617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004647617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:50.837344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3203): Terminating (SIGTERM) 00:46:50.877631 run iperf3-srv_10.42.42.10(pid=3204): Terminating (SIGTERM) 00:46:50.917934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3205): Terminating (SIGTERM) 00:46:50.958202 run iperf3-srv_10.42.42.10(pid=3206): Terminating (SIGTERM) 00:46:50.998303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3207): Terminating (SIGTERM) 00:46:51.038579 run iperf3-srv_10.42.42.10(pid=3208): Terminating (SIGTERM) 00:46:51.078612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3209): Terminating (SIGTERM) 00:46:51.118790 run iperf3-srv_10.42.42.10(pid=3210): Terminating (SIGTERM) 00:46:51.158694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3213): Terminating (SIGTERM) 00:46:51.198770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3216): Terminating (SIGTERM) 00:46:51.238810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3219): Terminating (SIGTERM) 00:46:51.278731 --- ParallelTerminationStrategy: PID 3203 died... 00:46:51.298381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3203): Terminated: ok {rc=0} 00:46:51.343219 --- ParallelTerminationStrategy: PID 3204 died... 00:46:51.361983 run iperf3-srv_10.42.42.10(pid=3204): Terminated {rc=256} 00:46:51.406736 --- ParallelTerminationStrategy: PID 3205 died... 00:46:51.425614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3205): Terminated: ok {rc=0} 00:46:51.470471 --- ParallelTerminationStrategy: PID 3206 died... 00:46:51.489219 run iperf3-srv_10.42.42.10(pid=3206): Terminated {rc=256} 00:46:51.538670 --- ParallelTerminationStrategy: PID 3207 died... 00:46:51.558586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3207): Terminated: ok {rc=0} 00:46:51.605563 --- ParallelTerminationStrategy: PID 3208 died... 00:46:51.625702 run iperf3-srv_10.42.42.10(pid=3208): Terminated {rc=256} 00:46:51.672569 --- ParallelTerminationStrategy: PID 3209 died... 00:46:51.692651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3209): Terminated: ok {rc=0} 00:46:51.739465 --- ParallelTerminationStrategy: PID 3210 died... 00:46:51.759268 run iperf3-srv_10.42.42.10(pid=3210): Terminated {rc=256} 00:46:51.806064 --- ParallelTerminationStrategy: PID 3213 died... 00:46:51.826095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3213): Terminated: ok {rc=0} 00:46:51.872885 --- ParallelTerminationStrategy: PID 3216 died... 00:46:51.893189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3216): Terminated: ok {rc=0} 00:46:51.940175 --- ParallelTerminationStrategy: PID 3219 died... 00:46:51.960055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3219): Terminated: ok {rc=0} 00:46:52.049076 bus /gobi_4: Setting Powered False 00:46:53.148560 bus /gobi_4: Setting Powered False 00:46:54.265666 bus /gobi_1: Setting Powered False 00:46:55.365594 bus /gobi_1: Setting Powered False 00:46:56.481867 bus /gobi_0: Setting Powered False 00:46:57.581853 bus /gobi_0: Setting Powered False 00:46:58.699453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo ping.py ---------------------------------------------- 00:46:59.802638 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:59.814535 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:59.850660 tst ping.py: using LAC 17899 00:46:59.981436 tst ping.py: using RAC 49 00:47:00.109778 tst ping.py: using CellId 17899 00:47:00.238912 tst ping.py: using BVCI 17900 00:47:00.358693 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:00.369864 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:00.380818 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:00.392001 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:00.409042 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:00.422384 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:00.432898 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:00.443774 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:47:00.561171 tst ping.py:19: start network... 00:47:00.783796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:01.332850 run create_hlr_db(pid=3222): Launched 00:47:01.498076 bus /gobi_6: Setting Powered False 00:47:02.563243 run create_hlr_db(pid=3222): Terminated: ok {rc=0} 00:47:03.022964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3224): Launched 00:47:03.353401 run osmo-hlr_10.42.42.2(pid=3225): Launched 00:47:03.479177 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:04.051213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3227): Launched 00:47:04.381399 run osmo-stp_10.42.42.5(pid=3228): Launched 00:47:04.506584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:05.075955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3230): Launched 00:47:05.201420 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:05.481666 run patchelf(pid=3231): Launched 00:47:05.667013 run osmo-stp_10.42.42.5(pid=3228): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3228)] 00:47:05.806935 run osmo-stp_10.42.42.5(pid=3228): stdout: | (launched: 2022-12-09_00:47:04.318995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:05.948282 run osmo-stp_10.42.42.5(pid=3228): stderr: | 20221209004704516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004704516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004704517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004704517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004704518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004704518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004704518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:06.089737 run osmo-stp_10.42.42.5(pid=3228): stdout: | (launched: 2022-12-09_00:47:04.318995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:06.224350 run osmo-stp_10.42.42.5(pid=3228): stderr: | 20221209004704516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004704516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004704517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004704517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004704518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004704518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004704518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:06.384565 run patchelf(pid=3231): Terminating (SIGINT) 00:47:06.568904 run patchelf(pid=3231): Terminated: ok {rc=0} 00:47:06.701480 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3228): Process ended prematurely: osmo-stp_10.42.42.5(pid=3228) [trial-2352↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3228)] [trial-2352↪gprs:sysmo↪ping.py:22] 00:47:06.711019 tst ping.py:22: Test FAILED (6.9 sec) 00:47:06.739321 run osmo-hlr_10.42.42.2(pid=3225): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3225)] 00:47:06.789958 run osmo-hlr_10.42.42.2(pid=3225): stdout: | (launched: 2022-12-09_00:47:03.291212) 00:47:06.842303 run osmo-hlr_10.42.42.2(pid=3225): stderr: | 20221209004703494 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004703494 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004703494 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004703494 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004703494 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004703494 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004703507 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004703515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004703516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004703516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:06.895088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3224): Terminating (SIGTERM) 00:47:06.937827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3227): Terminating (SIGTERM) 00:47:06.980576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3230): Terminating (SIGTERM) 00:47:07.023401 --- ParallelTerminationStrategy: PID 3224 died... 00:47:07.043888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3224): Terminated: ok {rc=0} 00:47:07.090806 --- ParallelTerminationStrategy: PID 3227 died... 00:47:07.110704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3227): Terminated: ok {rc=0} 00:47:07.157492 --- ParallelTerminationStrategy: PID 3230 died... 00:47:07.177295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3230): Terminated: ok {rc=0} 00:47:07.265333 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 00:47:08.353837 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:08.365135 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:47:08.402461 tst ping_idle_ping.py: using LAC 17900 00:47:08.535936 tst ping_idle_ping.py: using RAC 50 00:47:08.664295 tst ping_idle_ping.py: using CellId 17900 00:47:08.791427 tst ping_idle_ping.py: using BVCI 17901 00:47:08.912302 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:08.923417 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:08.934459 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:08.945445 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:08.956277 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:08.967162 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:08.978212 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:47:08.989228 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:47:09.114481 tst ping_idle_ping.py:24: start network... 00:47:09.339647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:09.852760 run create_hlr_db(pid=3232): Launched 00:47:09.985608 bus /gobi_6: Setting Powered False 00:47:11.050353 run create_hlr_db(pid=3232): Terminated: ok {rc=0} 00:47:11.490294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3234): Launched 00:47:11.799644 run osmo-hlr_10.42.42.2(pid=3235): Launched 00:47:11.916352 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:12.461202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3237): Launched 00:47:12.770104 run osmo-stp_10.42.42.5(pid=3238): Launched 00:47:12.886018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:13.416595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3240): Launched 00:47:13.534915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:13.796705 run patchelf(pid=3241): Launched 00:47:13.966474 run osmo-stp_10.42.42.5(pid=3238): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3238)] 00:47:14.096449 run osmo-stp_10.42.42.5(pid=3238): stdout: | (launched: 2022-12-09_00:47:12.711478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:14.228138 run osmo-stp_10.42.42.5(pid=3238): stderr: | 20221209004712884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004712884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004712884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004712885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004712887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004712887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004712887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:14.359819 run osmo-stp_10.42.42.5(pid=3238): stdout: | (launched: 2022-12-09_00:47:12.711478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:14.485302 run osmo-stp_10.42.42.5(pid=3238): stderr: | 20221209004712884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004712884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004712884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004712885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004712887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004712887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004712887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:14.633801 run patchelf(pid=3241): Terminating (SIGINT) 00:47:14.805401 run patchelf(pid=3241): Terminated: ok {rc=0} 00:47:14.929295 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3238): Process ended prematurely: osmo-stp_10.42.42.5(pid=3238) [trial-2352↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3238)] [trial-2352↪gprs:sysmo↪ping_idle_ping.py:27] 00:47:14.938341 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:47:14.965288 run osmo-hlr_10.42.42.2(pid=3235): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3235)] 00:47:15.013669 run osmo-hlr_10.42.42.2(pid=3235): stdout: | (launched: 2022-12-09_00:47:11.741683) 00:47:15.063424 run osmo-hlr_10.42.42.2(pid=3235): stderr: | 20221209004711919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004711919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004711919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004711919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004711919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004711919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004711931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004711942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004711942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004711942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:15.113701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3234): Terminating (SIGTERM) 00:47:15.153870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3237): Terminating (SIGTERM) 00:47:15.193965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3240): Terminating (SIGTERM) 00:47:15.234319 --- ParallelTerminationStrategy: PID 3234 died... 00:47:15.253466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3234): Terminated: ok {rc=0} 00:47:15.298011 --- ParallelTerminationStrategy: PID 3237 died... 00:47:15.316652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3237): Terminated: ok {rc=0} 00:47:15.361135 --- ParallelTerminationStrategy: PID 3240 died... 00:47:15.379705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3240): Terminated: ok {rc=0} 00:47:15.464308 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 00:47:16.793361 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:47:16.798963 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:47:16.821541 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:47:16.863047 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:47:16.952811 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:47:16.976472 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:47:17.018136 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:47:17.608663 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:47:17.662569 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:17.674302 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:17.712457 tst cs_paging_gprs_active.py: using LAC 17901 00:47:17.845247 tst cs_paging_gprs_active.py: using RAC 51 00:47:17.969360 tst cs_paging_gprs_active.py: using CellId 17901 00:47:18.093108 tst cs_paging_gprs_active.py: using BVCI 17902 00:47:18.209757 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:18.220756 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:18.231519 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:18.242390 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:18.253633 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:18.264499 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:18.275644 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:18.286577 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:18.297694 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:18.416407 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:18.535154 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:47:18.745465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:19.060539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3245): Launched 00:47:19.334627 run iperf3-srv_10.42.42.10(pid=3246): Launched 00:47:19.452032 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:47:19.661905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:19.977674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3247): Launched 00:47:20.251833 run iperf3-srv_10.42.42.10(pid=3248): Launched 00:47:20.369381 tst cs_paging_gprs_active.py:38: start network... 00:47:20.578983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:21.063881 run create_hlr_db(pid=3249): Launched 00:47:21.182635 bus /gobi_6: Setting Powered False 00:47:22.243753 run create_hlr_db(pid=3249): Terminated: ok {rc=0} 00:47:22.678884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3251): Launched 00:47:22.993663 run osmo-hlr_10.42.42.2(pid=3252): Launched 00:47:23.112728 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:23.664770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3254): Launched 00:47:23.979615 run osmo-stp_10.42.42.5(pid=3255): Launched 00:47:24.100819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:24.654201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3257): Launched 00:47:24.774323 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:25.039901 run patchelf(pid=3258): Launched 00:47:25.213857 run osmo-stp_10.42.42.5(pid=3255): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3255)] 00:47:25.346412 run osmo-stp_10.42.42.5(pid=3255): stdout: | (launched: 2022-12-09_00:47:23.919897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:25.480569 run osmo-stp_10.42.42.5(pid=3255): stderr: | 20221209004724095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004724095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004724095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004724096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004724096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004724096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004724096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:25.615231 run osmo-stp_10.42.42.5(pid=3255): stdout: | (launched: 2022-12-09_00:47:23.919897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:25.743271 run osmo-stp_10.42.42.5(pid=3255): stderr: | 20221209004724095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004724095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004724095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004724096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004724096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004724096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004724096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:25.894897 run patchelf(pid=3258): Terminating (SIGINT) 00:47:26.070419 run patchelf(pid=3258): Terminated: ok {rc=0} 00:47:26.197421 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3255): Process ended prematurely: osmo-stp_10.42.42.5(pid=3255) [trial-2352↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3255)] [trial-2352↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:47:26.206974 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 00:47:26.234671 run osmo-hlr_10.42.42.2(pid=3252): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3252)] 00:47:26.283790 run osmo-hlr_10.42.42.2(pid=3252): stdout: | (launched: 2022-12-09_00:47:22.933907) 00:47:26.334306 run osmo-hlr_10.42.42.2(pid=3252): stderr: | 20221209004723113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004723113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004723113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004723113 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004723113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004723113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004723125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004723134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004723134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004723134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:26.385228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3245): Terminating (SIGTERM) 00:47:26.425906 run iperf3-srv_10.42.42.10(pid=3246): Terminating (SIGTERM) 00:47:26.466552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3247): Terminating (SIGTERM) 00:47:26.507128 run iperf3-srv_10.42.42.10(pid=3248): Terminating (SIGTERM) 00:47:26.547698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3251): Terminating (SIGTERM) 00:47:26.588302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3254): Terminating (SIGTERM) 00:47:26.628797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3257): Terminating (SIGTERM) 00:47:26.669669 --- ParallelTerminationStrategy: PID 3245 died... 00:47:26.689066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3245): Terminated: ok {rc=0} 00:47:26.734142 --- ParallelTerminationStrategy: PID 3246 died... 00:47:26.752811 run iperf3-srv_10.42.42.10(pid=3246): Terminated {rc=256} 00:47:26.797574 --- ParallelTerminationStrategy: PID 3247 died... 00:47:26.816341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3247): Terminated: ok {rc=0} 00:47:26.861528 --- ParallelTerminationStrategy: PID 3248 died... 00:47:26.880191 run iperf3-srv_10.42.42.10(pid=3248): Terminated {rc=256} 00:47:26.924849 --- ParallelTerminationStrategy: PID 3251 died... 00:47:26.944013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3251): Terminated: ok {rc=0} 00:47:26.988671 --- ParallelTerminationStrategy: PID 3254 died... 00:47:27.007518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3254): Terminated: ok {rc=0} 00:47:27.052662 --- ParallelTerminationStrategy: PID 3257 died... 00:47:27.071691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3257): Terminated: ok {rc=0} 00:47:27.159707 bus /gobi_0: Setting Powered False 00:47:28.261540 bus /gobi_0: Setting Powered False 00:47:29.379867 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:47:30.530787 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:30.542545 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:30.584176 tst iperf3.py: using LAC 17902 00:47:30.722232 tst iperf3.py: using RAC 52 00:47:30.849689 tst iperf3.py: using CellId 17902 00:47:30.997492 tst iperf3.py: using BVCI 17903 00:47:31.118302 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.130366 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.142442 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.155296 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.169302 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.181145 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.194431 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.208477 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.221722 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:31.372920 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:47:31.648157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:32.001795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3259): Launched 00:47:32.289669 run iperf3-srv_10.42.42.10(pid=3260): Launched 00:47:32.407071 tst iperf3.py:8: start network... 00:47:32.615952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:33.100692 run create_hlr_db(pid=3261): Launched 00:47:33.220514 bus /gobi_6: Setting Powered False 00:47:34.281185 run create_hlr_db(pid=3261): Terminated: ok {rc=0} 00:47:34.715742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3263): Launched 00:47:35.028281 run osmo-hlr_10.42.42.2(pid=3264): Launched 00:47:35.147360 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:35.698793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3266): Launched 00:47:36.043249 run osmo-stp_10.42.42.5(pid=3269): Launched 00:47:36.163806 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:36.703531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3271): Launched 00:47:36.822658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:37.100409 run patchelf(pid=3272): Launched 00:47:37.286118 run osmo-stp_10.42.42.5(pid=3269): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3269)] 00:47:37.428112 run osmo-stp_10.42.42.5(pid=3269): stdout: | (launched: 2022-12-09_00:47:35.980031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:37.571570 run osmo-stp_10.42.42.5(pid=3269): stderr: | 20221209004736155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004736155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004736155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004736155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004736158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004736158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004736158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:37.715014 run osmo-stp_10.42.42.5(pid=3269): stdout: | (launched: 2022-12-09_00:47:35.980031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:37.852086 run osmo-stp_10.42.42.5(pid=3269): stderr: | 20221209004736155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004736155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004736155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004736155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004736158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004736158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004736158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:38.014489 run patchelf(pid=3272): Terminating (SIGINT) 00:47:38.201911 run patchelf(pid=3272): Terminated: ok {rc=0} 00:47:38.337113 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3269): Process ended prematurely: osmo-stp_10.42.42.5(pid=3269) [trial-2352↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3269)] [trial-2352↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 00:47:38.347407 tst iperf3.py:8: Test FAILED (7.9 sec) 00:47:38.376452 run osmo-hlr_10.42.42.2(pid=3264): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3264)] 00:47:38.427077 run osmo-hlr_10.42.42.2(pid=3264): stdout: | (launched: 2022-12-09_00:47:34.969397) 00:47:38.479473 run osmo-hlr_10.42.42.2(pid=3264): stderr: | 20221209004735149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004735149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004735149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004735149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004735149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004735149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004735162 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004735170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004735170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004735170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:38.531983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3259): Terminating (SIGTERM) 00:47:38.574281 run iperf3-srv_10.42.42.10(pid=3260): Terminating (SIGTERM) 00:47:38.616325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3263): Terminating (SIGTERM) 00:47:38.658522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3266): Terminating (SIGTERM) 00:47:38.700490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3271): Terminating (SIGTERM) 00:47:38.742989 --- ParallelTerminationStrategy: PID 3259 died... 00:47:38.762941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3259): Terminated: ok {rc=0} 00:47:38.809725 --- ParallelTerminationStrategy: PID 3260 died... 00:47:38.829388 run iperf3-srv_10.42.42.10(pid=3260): Terminated {rc=256} 00:47:38.875488 --- ParallelTerminationStrategy: PID 3263 died... 00:47:38.895163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3263): Terminated: ok {rc=0} 00:47:38.941597 --- ParallelTerminationStrategy: PID 3266 died... 00:47:38.961533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3266): Terminated: ok {rc=0} 00:47:39.008319 --- ParallelTerminationStrategy: PID 3271 died... 00:47:39.028097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3271): Terminated: ok {rc=0} 00:47:39.115882 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:47:40.265528 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:40.277247 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:40.318754 tst iperf3m4.py: using LAC 17903 00:47:40.441058 tst iperf3m4.py: using RAC 53 00:47:40.562180 tst iperf3m4.py: using CellId 17903 00:47:40.685322 tst iperf3m4.py: using BVCI 17904 00:47:40.798524 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:40.809492 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:40.820269 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:40.831695 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:40.843104 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:40.854565 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:40.866234 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:40.877565 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:40.889091 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:41.012552 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:41.136506 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:41.253439 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:41.373195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:47:41.600812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:41.941353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3273): Launched 00:47:42.235331 run iperf3-srv_10.42.42.10(pid=3274): Launched 00:47:42.361285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:47:42.587500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:42.926050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3275): Launched 00:47:43.219611 run iperf3-srv_10.42.42.10(pid=3276): Launched 00:47:43.345378 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:47:43.572551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:43.912331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3277): Launched 00:47:44.206157 run iperf3-srv_10.42.42.10(pid=3278): Launched 00:47:44.331761 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:47:44.558617 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:44.897579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3279): Launched 00:47:45.192127 run iperf3-srv_10.42.42.10(pid=3280): Launched 00:47:45.317624 tst iperf3m4.py:8: start network... 00:47:45.545197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:46.090093 run create_hlr_db(pid=3281): Launched 00:47:46.260273 bus /gobi_6: Setting Powered False 00:47:47.325759 run create_hlr_db(pid=3281): Terminated: ok {rc=0} 00:47:47.793101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3283): Launched 00:47:48.130031 run osmo-hlr_10.42.42.2(pid=3284): Launched 00:47:48.257537 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:48.839042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3286): Launched 00:47:49.175340 run osmo-stp_10.42.42.5(pid=3287): Launched 00:47:49.302623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:49.882038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3289): Launched 00:47:50.009831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:50.294776 run patchelf(pid=3290): Launched 00:47:50.481116 run osmo-stp_10.42.42.5(pid=3287): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3287)] 00:47:50.622827 run osmo-stp_10.42.42.5(pid=3287): stdout: | (launched: 2022-12-09_00:47:49.112307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:50.765727 run osmo-stp_10.42.42.5(pid=3287): stderr: | 20221209004749310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004749311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004749311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004749311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004749312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004749312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004749312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:50.908593 run osmo-stp_10.42.42.5(pid=3287): stdout: | (launched: 2022-12-09_00:47:49.112307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:51.045268 run osmo-stp_10.42.42.5(pid=3287): stderr: | 20221209004749310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004749311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004749311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004749311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004749312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004749312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004749312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:51.207301 run patchelf(pid=3290): Terminating (SIGINT) 00:47:51.395078 run patchelf(pid=3290): Terminated: ok {rc=0} 00:47:51.529988 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3287): Process ended prematurely: osmo-stp_10.42.42.5(pid=3287) [trial-2352↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3287)] [trial-2352↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 00:47:51.540179 tst iperf3m4.py:8: Test FAILED (11.3 sec) 00:47:51.569347 run osmo-hlr_10.42.42.2(pid=3284): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3284)] 00:47:51.620091 run osmo-hlr_10.42.42.2(pid=3284): stdout: | (launched: 2022-12-09_00:47:48.066950) 00:47:51.672652 run osmo-hlr_10.42.42.2(pid=3284): stderr: | 20221209004748270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004748270 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004748270 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004748270 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004748270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004748270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004748283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004748291 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004748292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004748292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:51.725645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3273): Terminating (SIGTERM) 00:47:51.768063 run iperf3-srv_10.42.42.10(pid=3274): Terminating (SIGTERM) 00:47:51.810472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3275): Terminating (SIGTERM) 00:47:51.853300 run iperf3-srv_10.42.42.10(pid=3276): Terminating (SIGTERM) 00:47:51.895976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3277): Terminating (SIGTERM) 00:47:51.938512 run iperf3-srv_10.42.42.10(pid=3278): Terminating (SIGTERM) 00:47:51.980823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3279): Terminating (SIGTERM) 00:47:52.023432 run iperf3-srv_10.42.42.10(pid=3280): Terminating (SIGTERM) 00:47:52.065847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3283): Terminating (SIGTERM) 00:47:52.108926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3286): Terminating (SIGTERM) 00:47:52.151800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3289): Terminating (SIGTERM) 00:47:52.194676 --- ParallelTerminationStrategy: PID 3273 died... 00:47:52.214951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3273): Terminated: ok {rc=0} 00:47:52.262100 --- ParallelTerminationStrategy: PID 3274 died... 00:47:52.282095 run iperf3-srv_10.42.42.10(pid=3274): Terminated {rc=256} 00:47:52.328844 --- ParallelTerminationStrategy: PID 3275 died... 00:47:52.349327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3275): Terminated: ok {rc=0} 00:47:52.396369 --- ParallelTerminationStrategy: PID 3276 died... 00:47:52.416472 run iperf3-srv_10.42.42.10(pid=3276): Terminated {rc=256} 00:47:52.463171 --- ParallelTerminationStrategy: PID 3277 died... 00:47:52.482962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3277): Terminated: ok {rc=0} 00:47:52.529756 --- ParallelTerminationStrategy: PID 3278 died... 00:47:52.549766 run iperf3-srv_10.42.42.10(pid=3278): Terminated {rc=256} 00:47:52.596537 --- ParallelTerminationStrategy: PID 3279 died... 00:47:52.616507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3279): Terminated: ok {rc=0} 00:47:52.663268 --- ParallelTerminationStrategy: PID 3280 died... 00:47:52.683220 run iperf3-srv_10.42.42.10(pid=3280): Terminated {rc=256} 00:47:52.730176 --- ParallelTerminationStrategy: PID 3283 died... 00:47:52.750287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3283): Terminated: ok {rc=0} 00:47:52.797234 --- ParallelTerminationStrategy: PID 3286 died... 00:47:52.817278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3286): Terminated: ok {rc=0} 00:47:52.864157 --- ParallelTerminationStrategy: PID 3289 died... 00:47:52.884170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3289): Terminated: ok {rc=0} 00:47:52.973574 bus /gobi_4: Setting Powered False 00:47:54.075166 bus /gobi_4: Setting Powered False 00:47:55.192801 bus /gobi_1: Setting Powered False 00:47:56.292273 bus /gobi_1: Setting Powered False 00:47:57.410165 bus /gobi_0: Setting Powered False 00:47:58.510049 bus /gobi_0: Setting Powered False 00:47:59.627473 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 00:48:00.731451 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:00.743543 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:48:00.782307 tst ping.py: using LAC 17904 00:48:00.919721 tst ping.py: using RAC 54 00:48:01.056937 tst ping.py: using CellId 17904 00:48:01.180078 tst ping.py: using BVCI 17905 00:48:01.334945 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:01.349891 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:01.362360 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:01.376029 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:01.387622 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:01.399158 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:01.413354 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:01.425950 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:48:01.578228 tst ping.py:19: start network... 00:48:01.808339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:02.318473 run create_hlr_db(pid=3291): Launched 00:48:02.487012 bus /gobi_6: Setting Powered False 00:48:03.552138 run create_hlr_db(pid=3291): Terminated: ok {rc=0} 00:48:04.013469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3293): Launched 00:48:04.345175 run osmo-hlr_10.42.42.2(pid=3294): Launched 00:48:04.470977 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:05.042051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3296): Launched 00:48:05.371935 run osmo-stp_10.42.42.5(pid=3297): Launched 00:48:05.500614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:06.070704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3299): Launched 00:48:06.195981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:06.476363 run patchelf(pid=3300): Launched 00:48:06.659386 run osmo-stp_10.42.42.5(pid=3297): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3297)] 00:48:06.798726 run osmo-stp_10.42.42.5(pid=3297): stdout: | (launched: 2022-12-09_00:48:05.309971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:06.939638 run osmo-stp_10.42.42.5(pid=3297): stderr: | 20221209004805504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004805504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004805504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004805505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004805507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004805507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004805507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:07.080538 run osmo-stp_10.42.42.5(pid=3297): stdout: | (launched: 2022-12-09_00:48:05.309971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:07.215120 run osmo-stp_10.42.42.5(pid=3297): stderr: | 20221209004805504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004805504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004805504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004805505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004805507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004805507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004805507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:07.375211 run patchelf(pid=3300): Terminating (SIGINT) 00:48:07.559193 run patchelf(pid=3300): Terminated: ok {rc=0} 00:48:07.691514 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3297): Process ended prematurely: osmo-stp_10.42.42.5(pid=3297) [trial-2352↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3297)] [trial-2352↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 00:48:07.701123 tst ping.py:22: Test FAILED (7.0 sec) 00:48:07.729565 run osmo-hlr_10.42.42.2(pid=3294): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3294)] 00:48:07.780353 run osmo-hlr_10.42.42.2(pid=3294): stdout: | (launched: 2022-12-09_00:48:04.282923) 00:48:07.832937 run osmo-hlr_10.42.42.2(pid=3294): stderr: | 20221209004804486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004804486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004804486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004804486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004804486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004804486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004804499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004804508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004804508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004804508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:07.885886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3293): Terminating (SIGTERM) 00:48:07.928769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3296): Terminating (SIGTERM) 00:48:07.971609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3299): Terminating (SIGTERM) 00:48:08.015364 --- ParallelTerminationStrategy: PID 3293 died... 00:48:08.035409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3293): Terminated: ok {rc=0} 00:48:08.083166 --- ParallelTerminationStrategy: PID 3296 died... 00:48:08.103333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3296): Terminated: ok {rc=0} 00:48:08.150632 --- ParallelTerminationStrategy: PID 3299 died... 00:48:08.170643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3299): Terminated: ok {rc=0} 00:48:08.259974 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:48:09.348292 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:09.359801 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:48:09.398536 tst ping_idle_ping.py: using LAC 17905 00:48:09.521347 tst ping_idle_ping.py: using RAC 55 00:48:09.644163 tst ping_idle_ping.py: using CellId 17905 00:48:09.766147 tst ping_idle_ping.py: using BVCI 17906 00:48:09.879881 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:09.890721 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:09.901494 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:09.912351 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:09.923125 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:09.934047 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:09.945108 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:48:09.955949 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:48:10.084615 tst ping_idle_ping.py:24: start network... 00:48:10.308274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:10.821138 run create_hlr_db(pid=3301): Launched 00:48:10.955521 bus /gobi_6: Setting Powered False 00:48:12.021030 run create_hlr_db(pid=3301): Terminated: ok {rc=0} 00:48:12.482652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3303): Launched 00:48:12.814199 run osmo-hlr_10.42.42.2(pid=3304): Launched 00:48:12.939531 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:13.512705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3306): Launched 00:48:13.843883 run osmo-stp_10.42.42.5(pid=3307): Launched 00:48:13.969072 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:14.544511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3309): Launched 00:48:14.670319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:14.951295 run patchelf(pid=3310): Launched 00:48:15.134238 run osmo-stp_10.42.42.5(pid=3307): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3307)] 00:48:15.273982 run osmo-stp_10.42.42.5(pid=3307): stdout: | (launched: 2022-12-09_00:48:13.781874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:15.415577 run osmo-stp_10.42.42.5(pid=3307): stderr: | 20221209004813978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004813978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004813978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004813979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004813979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004813979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004813979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:15.556389 run osmo-stp_10.42.42.5(pid=3307): stdout: | (launched: 2022-12-09_00:48:13.781874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:15.691543 run osmo-stp_10.42.42.5(pid=3307): stderr: | 20221209004813978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004813978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004813978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004813979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004813979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004813979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004813979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:15.860122 run patchelf(pid=3310): Terminating (SIGINT) 00:48:16.047450 run patchelf(pid=3310): Terminated: ok {rc=0} 00:48:16.183293 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3307): Process ended prematurely: osmo-stp_10.42.42.5(pid=3307) [trial-2352↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3307)] [trial-2352↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 00:48:16.194193 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 00:48:16.223877 run osmo-hlr_10.42.42.2(pid=3304): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3304)] 00:48:16.276827 run osmo-hlr_10.42.42.2(pid=3304): stdout: | (launched: 2022-12-09_00:48:12.752057) 00:48:16.330472 run osmo-hlr_10.42.42.2(pid=3304): stderr: | 20221209004812956 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004812956 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004812956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004812956 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004812956 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004812956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004812968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004812978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004812979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004812979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:16.385349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3303): Terminating (SIGTERM) 00:48:16.429141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3306): Terminating (SIGTERM) 00:48:16.472202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3309): Terminating (SIGTERM) 00:48:16.515905 --- ParallelTerminationStrategy: PID 3303 died... 00:48:16.536568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3303): Terminated: ok {rc=0} 00:48:16.585686 --- ParallelTerminationStrategy: PID 3306 died... 00:48:16.606005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3306): Terminated: ok {rc=0} 00:48:16.653608 --- ParallelTerminationStrategy: PID 3309 died... 00:48:16.674254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3309): Terminated: ok {rc=0} 00:48:16.765206 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:48:18.061024 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:48:18.067935 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:48:18.089881 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:48:18.130038 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:48:18.219459 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:48:18.240820 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:48:18.280069 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:48:18.875914 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:48:18.929688 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:18.940940 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:48:18.998725 tst cs_paging_gprs_active.py: using LAC 17906 00:48:19.129687 tst cs_paging_gprs_active.py: using RAC 56 00:48:19.261552 tst cs_paging_gprs_active.py: using CellId 17906 00:48:19.394624 tst cs_paging_gprs_active.py: using BVCI 17907 00:48:19.518837 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:19.530378 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:19.541709 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:19.552892 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:19.564137 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:19.575333 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:19.586711 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:19.597877 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:19.609387 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:19.732836 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:19.850511 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:48:20.079682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:20.420081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3314): Launched 00:48:20.714978 run iperf3-srv_10.42.42.10(pid=3315): Launched 00:48:20.841306 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:48:21.067621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:21.407495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3316): Launched 00:48:21.701604 run iperf3-srv_10.42.42.10(pid=3317): Launched 00:48:21.827494 tst cs_paging_gprs_active.py:38: start network... 00:48:22.054992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:22.580181 run create_hlr_db(pid=3318): Launched 00:48:22.715692 bus /gobi_6: Setting Powered False 00:48:23.781337 run create_hlr_db(pid=3318): Terminated: ok {rc=0} 00:48:24.231880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3320): Launched 00:48:24.548557 run osmo-hlr_10.42.42.2(pid=3321): Launched 00:48:24.668914 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:25.213547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3323): Launched 00:48:25.529309 run osmo-stp_10.42.42.5(pid=3324): Launched 00:48:25.648609 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:26.189594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3326): Launched 00:48:26.309865 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:26.577161 run patchelf(pid=3327): Launched 00:48:26.751242 run osmo-stp_10.42.42.5(pid=3324): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3324)] 00:48:26.883283 run osmo-stp_10.42.42.5(pid=3324): stdout: | (launched: 2022-12-09_00:48:25.469832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:27.018000 run osmo-stp_10.42.42.5(pid=3324): stderr: | 20221209004825644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004825644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004825644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004825645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004825647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004825647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004825647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:27.152838 run osmo-stp_10.42.42.5(pid=3324): stdout: | (launched: 2022-12-09_00:48:25.469832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:27.280506 run osmo-stp_10.42.42.5(pid=3324): stderr: | 20221209004825644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004825644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004825644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004825645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004825647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004825647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004825647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:27.432394 run patchelf(pid=3327): Terminating (SIGINT) 00:48:27.608494 run patchelf(pid=3327): Terminated: ok {rc=0} 00:48:27.735488 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3324): Process ended prematurely: osmo-stp_10.42.42.5(pid=3324) [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3324)] [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:48:27.744908 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 00:48:27.772851 run osmo-hlr_10.42.42.2(pid=3321): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3321)] 00:48:27.822052 run osmo-hlr_10.42.42.2(pid=3321): stdout: | (launched: 2022-12-09_00:48:24.489414) 00:48:27.872618 run osmo-hlr_10.42.42.2(pid=3321): stderr: | 20221209004824671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004824671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004824671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004824671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004824671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004824672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004824684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004824694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004824694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004824694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:27.923606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3314): Terminating (SIGTERM) 00:48:27.964238 run iperf3-srv_10.42.42.10(pid=3315): Terminating (SIGTERM) 00:48:28.004707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3316): Terminating (SIGTERM) 00:48:28.045351 run iperf3-srv_10.42.42.10(pid=3317): Terminating (SIGTERM) 00:48:28.085743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3320): Terminating (SIGTERM) 00:48:28.126369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3323): Terminating (SIGTERM) 00:48:28.167245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3326): Terminating (SIGTERM) 00:48:28.208039 --- ParallelTerminationStrategy: PID 3314 died... 00:48:28.227407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3314): Terminated: ok {rc=0} 00:48:28.272733 --- ParallelTerminationStrategy: PID 3315 died... 00:48:28.291644 run iperf3-srv_10.42.42.10(pid=3315): Terminated {rc=256} 00:48:28.336668 --- ParallelTerminationStrategy: PID 3316 died... 00:48:28.355674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3316): Terminated: ok {rc=0} 00:48:28.400711 --- ParallelTerminationStrategy: PID 3317 died... 00:48:28.419561 run iperf3-srv_10.42.42.10(pid=3317): Terminated {rc=256} 00:48:28.464689 --- ParallelTerminationStrategy: PID 3320 died... 00:48:28.483690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3320): Terminated: ok {rc=0} 00:48:28.528832 --- ParallelTerminationStrategy: PID 3323 died... 00:48:28.548083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3323): Terminated: ok {rc=0} 00:48:28.593207 --- ParallelTerminationStrategy: PID 3326 died... 00:48:28.611982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3326): Terminated: ok {rc=0} 00:48:28.699842 bus /gobi_0: Setting Powered False 00:48:29.800437 bus /gobi_0: Setting Powered False 00:48:30.928241 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:48:32.084615 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.097922 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:48:32.161368 tst iperf3.py: using LAC 17907 00:48:32.296418 tst iperf3.py: using RAC 57 00:48:32.431530 tst iperf3.py: using CellId 17907 00:48:32.564401 tst iperf3.py: using BVCI 17908 00:48:32.688171 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.699792 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.711203 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.723197 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.734946 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.746721 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.758595 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.770244 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.782168 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:32.900842 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:48:33.128745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:33.468059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Launched 00:48:33.762326 run iperf3-srv_10.42.42.10(pid=3329): Launched 00:48:33.887920 tst iperf3.py:8: start network... 00:48:34.114834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:34.636785 run create_hlr_db(pid=3330): Launched 00:48:34.771829 bus /gobi_6: Setting Powered False 00:48:35.837813 run create_hlr_db(pid=3330): Terminated: ok {rc=0} 00:48:36.284659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3332): Launched 00:48:36.597958 run osmo-hlr_10.42.42.2(pid=3333): Launched 00:48:36.716348 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:37.267776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3335): Launched 00:48:37.582428 run osmo-stp_10.42.42.5(pid=3336): Launched 00:48:37.702198 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:38.241140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3338): Launched 00:48:38.361077 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:38.626258 run patchelf(pid=3339): Launched 00:48:38.799165 run osmo-stp_10.42.42.5(pid=3336): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3336)] 00:48:38.931116 run osmo-stp_10.42.42.5(pid=3336): stdout: | (launched: 2022-12-09_00:48:37.523004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:39.064212 run osmo-stp_10.42.42.5(pid=3336): stderr: | 20221209004837696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004837696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004837697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004837697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004837698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004837698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004837698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:39.197401 run osmo-stp_10.42.42.5(pid=3336): stdout: | (launched: 2022-12-09_00:48:37.523004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:39.324258 run osmo-stp_10.42.42.5(pid=3336): stderr: | 20221209004837696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004837696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004837697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004837697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004837698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004837698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004837698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:39.475187 run patchelf(pid=3339): Terminating (SIGINT) 00:48:39.650006 run patchelf(pid=3339): Terminated: ok {rc=0} 00:48:39.776483 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3336): Process ended prematurely: osmo-stp_10.42.42.5(pid=3336) [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3336)] [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 00:48:39.786165 tst iperf3.py:8: Test FAILED (7.7 sec) 00:48:39.814215 run osmo-hlr_10.42.42.2(pid=3333): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3333)] 00:48:39.862602 run osmo-hlr_10.42.42.2(pid=3333): stdout: | (launched: 2022-12-09_00:48:36.539048) 00:48:39.912707 run osmo-hlr_10.42.42.2(pid=3333): stderr: | 20221209004836717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004836717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004836717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004836717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004836717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004836717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004836730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004836741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004836741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004836741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:39.963502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Terminating (SIGTERM) 00:48:40.004067 run iperf3-srv_10.42.42.10(pid=3329): Terminating (SIGTERM) 00:48:40.044554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3332): Terminating (SIGTERM) 00:48:40.085137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3335): Terminating (SIGTERM) 00:48:40.125807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3338): Terminating (SIGTERM) 00:48:40.166711 --- ParallelTerminationStrategy: PID 3328 died... 00:48:40.186120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Terminated: ok {rc=0} 00:48:40.231044 --- ParallelTerminationStrategy: PID 3329 died... 00:48:40.250181 run iperf3-srv_10.42.42.10(pid=3329): Terminated {rc=256} 00:48:40.295452 --- ParallelTerminationStrategy: PID 3332 died... 00:48:40.314421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3332): Terminated: ok {rc=0} 00:48:40.359498 --- ParallelTerminationStrategy: PID 3335 died... 00:48:40.378381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3335): Terminated: ok {rc=0} 00:48:40.423190 --- ParallelTerminationStrategy: PID 3338 died... 00:48:40.442212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3338): Terminated: ok {rc=0} 00:48:40.527552 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:48:41.680112 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:41.692449 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:48:41.752320 tst iperf3m4.py: using LAC 17908 00:48:41.882995 tst iperf3m4.py: using RAC 58 00:48:42.015619 tst iperf3m4.py: using CellId 17908 00:48:42.148299 tst iperf3m4.py: using BVCI 17909 00:48:42.265600 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.276700 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.287451 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.298932 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.310444 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.321773 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.333325 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.344551 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.356145 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:42.477212 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:42.598027 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:42.717654 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:42.840006 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:48:43.067354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:43.406286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3340): Launched 00:48:43.701591 run iperf3-srv_10.42.42.10(pid=3341): Launched 00:48:43.826981 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:48:44.054199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:44.393565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3342): Launched 00:48:44.688752 run iperf3-srv_10.42.42.10(pid=3343): Launched 00:48:44.814023 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:48:45.039875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:45.378346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3344): Launched 00:48:45.671869 run iperf3-srv_10.42.42.10(pid=3345): Launched 00:48:45.796800 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:48:46.034185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:46.384000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3346): Launched 00:48:46.693519 run iperf3-srv_10.42.42.10(pid=3347): Launched 00:48:46.833652 tst iperf3m4.py:8: start network... 00:48:47.064238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:47.588461 run create_hlr_db(pid=3348): Launched 00:48:47.723274 bus /gobi_6: Setting Powered False 00:48:48.789170 run create_hlr_db(pid=3348): Terminated: ok {rc=0} 00:48:49.255486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3350): Launched 00:48:49.592122 run osmo-hlr_10.42.42.2(pid=3351): Launched 00:48:49.720092 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:50.297298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3353): Launched 00:48:50.633360 run osmo-stp_10.42.42.5(pid=3354): Launched 00:48:50.761135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:51.340526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3356): Launched 00:48:51.468420 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:51.752009 run patchelf(pid=3357): Launched 00:48:51.937203 run osmo-stp_10.42.42.5(pid=3354): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3354)] 00:48:52.078636 run osmo-stp_10.42.42.5(pid=3354): stdout: | (launched: 2022-12-09_00:48:50.570509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:52.221124 run osmo-stp_10.42.42.5(pid=3354): stderr: | 20221209004850769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004850769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004850769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004850770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004850770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004850770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004850770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:52.364173 run osmo-stp_10.42.42.5(pid=3354): stdout: | (launched: 2022-12-09_00:48:50.570509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:52.501072 run osmo-stp_10.42.42.5(pid=3354): stderr: | 20221209004850769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004850769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004850769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004850770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004850770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004850770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004850770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:52.662595 run patchelf(pid=3357): Terminating (SIGINT) 00:48:52.849207 run patchelf(pid=3357): Terminated: ok {rc=0} 00:48:52.983893 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3354): Process ended prematurely: osmo-stp_10.42.42.5(pid=3354) [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3354)] [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:48:52.994109 tst iperf3m4.py:8: Test FAILED (11.4 sec) 00:48:53.022973 run osmo-hlr_10.42.42.2(pid=3351): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3351)] 00:48:53.073370 run osmo-hlr_10.42.42.2(pid=3351): stdout: | (launched: 2022-12-09_00:48:49.529511) 00:48:53.125296 run osmo-hlr_10.42.42.2(pid=3351): stderr: | 20221209004849733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004849733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004849733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004849733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004849733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004849733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004849749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004849759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004849759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004849759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:53.177562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3340): Terminating (SIGTERM) 00:48:53.219294 run iperf3-srv_10.42.42.10(pid=3341): Terminating (SIGTERM) 00:48:53.260932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3342): Terminating (SIGTERM) 00:48:53.302892 run iperf3-srv_10.42.42.10(pid=3343): Terminating (SIGTERM) 00:48:53.345065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3344): Terminating (SIGTERM) 00:48:53.387195 run iperf3-srv_10.42.42.10(pid=3345): Terminating (SIGTERM) 00:48:53.429773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3346): Terminating (SIGTERM) 00:48:53.472056 run iperf3-srv_10.42.42.10(pid=3347): Terminating (SIGTERM) 00:48:53.514080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3350): Terminating (SIGTERM) 00:48:53.556456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3353): Terminating (SIGTERM) 00:48:53.598636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3356): Terminating (SIGTERM) 00:48:53.641051 --- ParallelTerminationStrategy: PID 3340 died... 00:48:53.661413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3340): Terminated: ok {rc=0} 00:48:53.708178 --- ParallelTerminationStrategy: PID 3341 died... 00:48:53.727883 run iperf3-srv_10.42.42.10(pid=3341): Terminated {rc=256} 00:48:53.774372 --- ParallelTerminationStrategy: PID 3342 died... 00:48:53.794216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3342): Terminated: ok {rc=0} 00:48:53.840777 --- ParallelTerminationStrategy: PID 3343 died... 00:48:53.860617 run iperf3-srv_10.42.42.10(pid=3343): Terminated {rc=256} 00:48:53.907200 --- ParallelTerminationStrategy: PID 3344 died... 00:48:53.927031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3344): Terminated: ok {rc=0} 00:48:53.973632 --- ParallelTerminationStrategy: PID 3345 died... 00:48:53.993387 run iperf3-srv_10.42.42.10(pid=3345): Terminated {rc=256} 00:48:54.039887 --- ParallelTerminationStrategy: PID 3346 died... 00:48:54.059695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3346): Terminated: ok {rc=0} 00:48:54.106287 --- ParallelTerminationStrategy: PID 3347 died... 00:48:54.126144 run iperf3-srv_10.42.42.10(pid=3347): Terminated {rc=256} 00:48:54.172887 --- ParallelTerminationStrategy: PID 3350 died... 00:48:54.192807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3350): Terminated: ok {rc=0} 00:48:54.239707 --- ParallelTerminationStrategy: PID 3353 died... 00:48:54.259570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3353): Terminated: ok {rc=0} 00:48:54.306410 --- ParallelTerminationStrategy: PID 3356 died... 00:48:54.326343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3356): Terminated: ok {rc=0} 00:48:54.416277 bus /gobi_4: Setting Powered False 00:48:55.518160 bus /gobi_4: Setting Powered False 00:48:56.637650 bus /gobi_1: Setting Powered False 00:48:57.737517 bus /gobi_1: Setting Powered False 00:48:58.854027 bus /gobi_0: Setting Powered False 00:48:59.953090 bus /gobi_0: Setting Powered False 00:49:01.071179 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:49:02.174891 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:02.187429 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:49:02.248127 tst ping.py: using LAC 17909 00:49:02.371334 tst ping.py: using RAC 59 00:49:02.494263 tst ping.py: using CellId 17909 00:49:02.619413 tst ping.py: using BVCI 17910 00:49:02.732563 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:02.743546 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:02.754404 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:02.765447 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:02.776222 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:02.787098 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:02.798228 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:02.809139 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:49:02.927109 tst ping.py:19: start network... 00:49:03.132512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:03.606329 run create_hlr_db(pid=3358): Launched 00:49:03.722873 bus /gobi_6: Setting Powered False 00:49:04.783892 run create_hlr_db(pid=3358): Terminated: ok {rc=0} 00:49:05.235833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3360): Launched 00:49:05.567310 run osmo-hlr_10.42.42.2(pid=3361): Launched 00:49:05.691685 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:06.267197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3363): Launched 00:49:06.598734 run osmo-stp_10.42.42.5(pid=3364): Launched 00:49:06.724072 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:07.294370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3366): Launched 00:49:07.419806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:07.699299 run patchelf(pid=3367): Launched 00:49:07.881419 run osmo-stp_10.42.42.5(pid=3364): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3364)] 00:49:08.020299 run osmo-stp_10.42.42.5(pid=3364): stdout: | (launched: 2022-12-09_00:49:06.536474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:08.160508 run osmo-stp_10.42.42.5(pid=3364): stderr: | 20221209004906731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004906731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004906732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004906732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004906734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004906735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004906735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:08.300589 run osmo-stp_10.42.42.5(pid=3364): stdout: | (launched: 2022-12-09_00:49:06.536474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:08.435228 run osmo-stp_10.42.42.5(pid=3364): stderr: | 20221209004906731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004906731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004906732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004906732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004906734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004906735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004906735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:08.594951 run patchelf(pid=3367): Terminating (SIGINT) 00:49:08.778360 run patchelf(pid=3367): Terminated: ok {rc=0} 00:49:08.910150 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3364): Process ended prematurely: osmo-stp_10.42.42.5(pid=3364) [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3364)] [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 00:49:08.919707 tst ping.py:22: Test FAILED (6.7 sec) 00:49:08.947961 run osmo-hlr_10.42.42.2(pid=3361): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3361)] 00:49:08.998402 run osmo-hlr_10.42.42.2(pid=3361): stdout: | (launched: 2022-12-09_00:49:05.505612) 00:49:09.050483 run osmo-hlr_10.42.42.2(pid=3361): stderr: | 20221209004905706 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004905706 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004905707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004905707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004905707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004905707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004905718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004905726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004905726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004905727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:09.102853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3360): Terminating (SIGTERM) 00:49:09.144900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3363): Terminating (SIGTERM) 00:49:09.187027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3366): Terminating (SIGTERM) 00:49:09.229389 --- ParallelTerminationStrategy: PID 3360 died... 00:49:09.248913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3360): Terminated: ok {rc=0} 00:49:09.295506 --- ParallelTerminationStrategy: PID 3363 died... 00:49:09.315132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3363): Terminated: ok {rc=0} 00:49:09.361283 --- ParallelTerminationStrategy: PID 3366 died... 00:49:09.380886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3366): Terminated: ok {rc=0} 00:49:09.468697 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:49:10.557657 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:10.570181 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:49:10.629945 tst ping_idle_ping.py: using LAC 17910 00:49:10.759493 tst ping_idle_ping.py: using RAC 60 00:49:10.889341 tst ping_idle_ping.py: using CellId 17910 00:49:11.023201 tst ping_idle_ping.py: using BVCI 17911 00:49:11.143870 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:11.155302 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:11.166505 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:11.177714 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:11.188726 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:11.199834 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:11.211152 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:11.222400 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:49:11.337611 tst ping_idle_ping.py:24: start network... 00:49:11.543798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:12.022333 run create_hlr_db(pid=3369): Launched 00:49:12.141200 bus /gobi_6: Setting Powered False 00:49:13.201204 run create_hlr_db(pid=3369): Terminated: ok {rc=0} 00:49:13.632755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3371): Launched 00:49:13.942542 run osmo-hlr_10.42.42.2(pid=3372): Launched 00:49:14.060021 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:14.605884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3374): Launched 00:49:14.915374 run osmo-stp_10.42.42.5(pid=3375): Launched 00:49:15.032642 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:15.567728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3377): Launched 00:49:15.685421 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:15.991572 run patchelf(pid=3378): Launched 00:49:16.234973 run osmo-stp_10.42.42.5(pid=3375): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3375)] 00:49:16.369778 run osmo-stp_10.42.42.5(pid=3375): stdout: | (launched: 2022-12-09_00:49:14.856817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:16.505908 run osmo-stp_10.42.42.5(pid=3375): stderr: | 20221209004915028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004915028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004915028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004915029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004915029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004915029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004915029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:16.642576 run osmo-stp_10.42.42.5(pid=3375): stdout: | (launched: 2022-12-09_00:49:14.856817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:16.771778 run osmo-stp_10.42.42.5(pid=3375): stderr: | 20221209004915028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004915028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004915028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004915029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004915029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004915029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004915029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:16.924877 run patchelf(pid=3378): Terminating (SIGINT) 00:49:17.101955 run patchelf(pid=3378): Terminated: ok {rc=0} 00:49:17.230440 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3375): Process ended prematurely: osmo-stp_10.42.42.5(pid=3375) [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3375)] [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:49:17.239857 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 00:49:17.267485 run osmo-hlr_10.42.42.2(pid=3372): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3372)] 00:49:17.316677 run osmo-hlr_10.42.42.2(pid=3372): stdout: | (launched: 2022-12-09_00:49:13.883970) 00:49:17.367360 run osmo-hlr_10.42.42.2(pid=3372): stderr: | 20221209004914065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004914065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004914065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004914065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004914066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004914066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004914078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004914086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004914086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004914086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:17.418403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3371): Terminating (SIGTERM) 00:49:17.459523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3374): Terminating (SIGTERM) 00:49:17.500470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3377): Terminating (SIGTERM) 00:49:17.541499 --- ParallelTerminationStrategy: PID 3371 died... 00:49:17.560751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3371): Terminated: ok {rc=0} 00:49:17.606272 --- ParallelTerminationStrategy: PID 3374 died... 00:49:17.625803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3374): Terminated: ok {rc=0} 00:49:17.671009 --- ParallelTerminationStrategy: PID 3377 died... 00:49:17.690170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3377): Terminated: ok {rc=0} 00:49:17.777692 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:49:19.065326 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:49:19.071265 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:49:19.092348 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:49:19.131803 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:49:19.218902 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:49:19.239374 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:49:19.278265 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:49:19.869910 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:49:19.920474 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:19.931385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:49:19.987948 tst cs_paging_gprs_active.py: using LAC 17911 00:49:20.111963 tst cs_paging_gprs_active.py: using RAC 61 00:49:20.235737 tst cs_paging_gprs_active.py: using CellId 17911 00:49:20.360336 tst cs_paging_gprs_active.py: using BVCI 17912 00:49:20.476026 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:20.487045 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:20.497756 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:20.508699 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:20.519601 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:20.530646 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:20.541654 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:20.552411 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:20.563824 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:20.684204 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:20.804066 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:49:21.030822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:21.369594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3382): Launched 00:49:21.665337 run iperf3-srv_10.42.42.10(pid=3383): Launched 00:49:21.791797 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:49:22.020104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:22.360581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3384): Launched 00:49:22.657585 run iperf3-srv_10.42.42.10(pid=3385): Launched 00:49:22.784080 tst cs_paging_gprs_active.py:38: start network... 00:49:23.011355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:23.536340 run create_hlr_db(pid=3386): Launched 00:49:23.674201 bus /gobi_6: Setting Powered False 00:49:24.739883 run create_hlr_db(pid=3386): Terminated: ok {rc=0} 00:49:25.186652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3389): Launched 00:49:25.500611 run osmo-hlr_10.42.42.2(pid=3390): Launched 00:49:25.620362 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:26.172395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3392): Launched 00:49:26.486032 run osmo-stp_10.42.42.5(pid=3393): Launched 00:49:26.606012 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:27.144550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3395): Launched 00:49:27.264084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:27.530433 run patchelf(pid=3396): Launched 00:49:27.704518 run osmo-stp_10.42.42.5(pid=3393): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3393)] 00:49:27.836689 run osmo-stp_10.42.42.5(pid=3393): stdout: | (launched: 2022-12-09_00:49:26.427079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:27.971337 run osmo-stp_10.42.42.5(pid=3393): stderr: | 20221209004926600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004926601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004926601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004926602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004926602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004926602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004926602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:28.105913 run osmo-stp_10.42.42.5(pid=3393): stdout: | (launched: 2022-12-09_00:49:26.427079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:28.233315 run osmo-stp_10.42.42.5(pid=3393): stderr: | 20221209004926600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004926601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004926601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004926602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004926602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004926602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004926602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:28.384295 run patchelf(pid=3396): Terminating (SIGINT) 00:49:28.560188 run patchelf(pid=3396): Terminated: ok {rc=0} 00:49:28.687545 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3393): Process ended prematurely: osmo-stp_10.42.42.5(pid=3393) [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3393)] [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:49:28.697134 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:49:28.725184 run osmo-hlr_10.42.42.2(pid=3390): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3390)] 00:49:28.773336 run osmo-hlr_10.42.42.2(pid=3390): stdout: | (launched: 2022-12-09_00:49:25.441459) 00:49:28.823518 run osmo-hlr_10.42.42.2(pid=3390): stderr: | 20221209004925620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004925620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004925620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004925620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004925620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004925620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004925636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004925648 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004925648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004925648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:28.873899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3382): Terminating (SIGTERM) 00:49:28.914312 run iperf3-srv_10.42.42.10(pid=3383): Terminating (SIGTERM) 00:49:28.954689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3384): Terminating (SIGTERM) 00:49:28.995199 run iperf3-srv_10.42.42.10(pid=3385): Terminating (SIGTERM) 00:49:29.035497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3389): Terminating (SIGTERM) 00:49:29.075802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3392): Terminating (SIGTERM) 00:49:29.116144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3395): Terminating (SIGTERM) 00:49:29.156471 --- ParallelTerminationStrategy: PID 3382 died... 00:49:29.175728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3382): Terminated: ok {rc=0} 00:49:29.220547 --- ParallelTerminationStrategy: PID 3383 died... 00:49:29.239355 run iperf3-srv_10.42.42.10(pid=3383): Terminated {rc=256} 00:49:29.284066 --- ParallelTerminationStrategy: PID 3384 died... 00:49:29.302890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3384): Terminated: ok {rc=0} 00:49:29.347328 --- ParallelTerminationStrategy: PID 3385 died... 00:49:29.366023 run iperf3-srv_10.42.42.10(pid=3385): Terminated {rc=256} 00:49:29.410737 --- ParallelTerminationStrategy: PID 3389 died... 00:49:29.429450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3389): Terminated: ok {rc=0} 00:49:29.474071 --- ParallelTerminationStrategy: PID 3392 died... 00:49:29.492767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3392): Terminated: ok {rc=0} 00:49:29.537836 --- ParallelTerminationStrategy: PID 3395 died... 00:49:29.556500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3395): Terminated: ok {rc=0} 00:49:29.643376 bus /gobi_0: Setting Powered False 00:49:30.741980 bus /gobi_0: Setting Powered False 00:49:31.875283 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:49:33.031568 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:33.043171 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:49:33.103323 tst iperf3.py: using LAC 17912 00:49:33.227755 tst iperf3.py: using RAC 62 00:49:33.351012 tst iperf3.py: using CellId 17912 00:49:33.476036 tst iperf3.py: using BVCI 17913 00:49:33.591403 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:33.602400 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:33.613259 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:33.624229 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:33.635061 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:33.646077 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:33.657178 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:33.668094 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:33.679144 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:33.799615 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:49:34.028469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:34.367946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3397): Launched 00:49:34.663161 run iperf3-srv_10.42.42.10(pid=3398): Launched 00:49:34.790458 tst iperf3.py:8: start network... 00:49:35.018278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:35.542161 run create_hlr_db(pid=3399): Launched 00:49:35.680489 bus /gobi_6: Setting Powered False 00:49:36.746847 run create_hlr_db(pid=3399): Terminated: ok {rc=0} 00:49:37.214084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3401): Launched 00:49:37.553032 run osmo-hlr_10.42.42.2(pid=3402): Launched 00:49:37.682017 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:38.265071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3404): Launched 00:49:38.602274 run osmo-stp_10.42.42.5(pid=3405): Launched 00:49:38.730674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:39.312738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3407): Launched 00:49:39.441484 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:39.727606 run patchelf(pid=3408): Launched 00:49:39.913845 run osmo-stp_10.42.42.5(pid=3405): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3405)] 00:49:40.056131 run osmo-stp_10.42.42.5(pid=3405): stdout: | (launched: 2022-12-09_00:49:38.539230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:40.199652 run osmo-stp_10.42.42.5(pid=3405): stderr: | 20221209004938737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004938737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004938737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004938738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004938738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004938738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004938738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:40.343536 run osmo-stp_10.42.42.5(pid=3405): stdout: | (launched: 2022-12-09_00:49:38.539230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:40.481271 run osmo-stp_10.42.42.5(pid=3405): stderr: | 20221209004938737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004938737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004938737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004938738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004938738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004938738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004938738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:40.643798 run patchelf(pid=3408): Terminating (SIGINT) 00:49:40.832691 run patchelf(pid=3408): Terminated: ok {rc=0} 00:49:40.968166 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3405): Process ended prematurely: osmo-stp_10.42.42.5(pid=3405) [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3405)] [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 00:49:40.978587 tst iperf3.py:8: Test FAILED (8.0 sec) 00:49:41.007416 run osmo-hlr_10.42.42.2(pid=3402): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3402)] 00:49:41.057889 run osmo-hlr_10.42.42.2(pid=3402): stdout: | (launched: 2022-12-09_00:49:37.490101) 00:49:41.110383 run osmo-hlr_10.42.42.2(pid=3402): stderr: | 20221209004937694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004937694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004937694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004937694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004937694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004937694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004937707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004937718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004937718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004937718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:41.163161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3397): Terminating (SIGTERM) 00:49:41.205589 run iperf3-srv_10.42.42.10(pid=3398): Terminating (SIGTERM) 00:49:41.247878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3401): Terminating (SIGTERM) 00:49:41.290095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3404): Terminating (SIGTERM) 00:49:41.332344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3407): Terminating (SIGTERM) 00:49:41.374905 --- ParallelTerminationStrategy: PID 3397 died... 00:49:41.395294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3397): Terminated: ok {rc=0} 00:49:41.442846 --- ParallelTerminationStrategy: PID 3398 died... 00:49:41.462773 run iperf3-srv_10.42.42.10(pid=3398): Terminated {rc=256} 00:49:41.509317 --- ParallelTerminationStrategy: PID 3401 died... 00:49:41.529182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3401): Terminated: ok {rc=0} 00:49:41.575675 --- ParallelTerminationStrategy: PID 3404 died... 00:49:41.595606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3404): Terminated: ok {rc=0} 00:49:41.642293 --- ParallelTerminationStrategy: PID 3407 died... 00:49:41.662235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3407): Terminated: ok {rc=0} 00:49:41.750992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:49:42.905801 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:42.918098 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:49:42.977719 tst iperf3m4.py: using LAC 17913 00:49:43.110334 tst iperf3m4.py: using RAC 63 00:49:43.243684 tst iperf3m4.py: using CellId 17913 00:49:43.376816 tst iperf3m4.py: using BVCI 17914 00:49:43.499301 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:43.510788 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:43.522056 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:43.533515 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:43.544560 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:43.555839 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:43.567186 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:43.578364 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:43.589701 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:43.711246 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:43.832927 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:43.953861 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:44.076113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:49:44.303253 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:44.643132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3409): Launched 00:49:44.937163 run iperf3-srv_10.42.42.10(pid=3410): Launched 00:49:45.062863 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:49:45.289785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:45.629721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3411): Launched 00:49:45.943783 run iperf3-srv_10.42.42.10(pid=3412): Launched 00:49:46.085490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:49:46.316687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:46.662554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3413): Launched 00:49:46.978093 run iperf3-srv_10.42.42.10(pid=3414): Launched 00:49:47.121515 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:49:47.351608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:47.691472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3415): Launched 00:49:47.985118 run iperf3-srv_10.42.42.10(pid=3416): Launched 00:49:48.110787 tst iperf3m4.py:8: start network... 00:49:48.337310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:48.859956 run create_hlr_db(pid=3417): Launched 00:49:48.995306 bus /gobi_6: Setting Powered False 00:49:50.060878 run create_hlr_db(pid=3417): Terminated: ok {rc=0} 00:49:50.529052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3419): Launched 00:49:50.866521 run osmo-hlr_10.42.42.2(pid=3420): Launched 00:49:50.994225 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:51.581672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3422): Launched 00:49:51.918996 run osmo-stp_10.42.42.5(pid=3423): Launched 00:49:52.046636 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:52.630927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3425): Launched 00:49:52.759725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:53.048169 run patchelf(pid=3426): Launched 00:49:53.235445 run osmo-stp_10.42.42.5(pid=3423): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3423)] 00:49:53.377790 run osmo-stp_10.42.42.5(pid=3423): stdout: | (launched: 2022-12-09_00:49:51.855708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:53.522233 run osmo-stp_10.42.42.5(pid=3423): stderr: | 20221209004952052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004952052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004952053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004952053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004952055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004952056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004952056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:53.666488 run osmo-stp_10.42.42.5(pid=3423): stdout: | (launched: 2022-12-09_00:49:51.855708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:53.803971 run osmo-stp_10.42.42.5(pid=3423): stderr: | 20221209004952052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209004952052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209004952053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209004952053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209004952055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209004952056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209004952056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:53.967160 run patchelf(pid=3426): Terminating (SIGINT) 00:49:54.155401 run patchelf(pid=3426): Terminated: ok {rc=0} 00:49:54.291157 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3423): Process ended prematurely: osmo-stp_10.42.42.5(pid=3423) [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3423)] [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:49:54.301373 tst iperf3m4.py:8: Test FAILED (11.4 sec) 00:49:54.330731 run osmo-hlr_10.42.42.2(pid=3420): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3420)] 00:49:54.381636 run osmo-hlr_10.42.42.2(pid=3420): stdout: | (launched: 2022-12-09_00:49:50.802982) 00:49:54.434577 run osmo-hlr_10.42.42.2(pid=3420): stderr: | 20221209004951008 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209004951008 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209004951008 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209004951008 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209004951008 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209004951008 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209004951021 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209004951029 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209004951029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209004951029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:54.487748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3409): Terminating (SIGTERM) 00:49:54.530370 run iperf3-srv_10.42.42.10(pid=3410): Terminating (SIGTERM) 00:49:54.572808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3411): Terminating (SIGTERM) 00:49:54.615623 run iperf3-srv_10.42.42.10(pid=3412): Terminating (SIGTERM) 00:49:54.658050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3413): Terminating (SIGTERM) 00:49:54.700844 run iperf3-srv_10.42.42.10(pid=3414): Terminating (SIGTERM) 00:49:54.743435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3415): Terminating (SIGTERM) 00:49:54.785997 run iperf3-srv_10.42.42.10(pid=3416): Terminating (SIGTERM) 00:49:54.828746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3419): Terminating (SIGTERM) 00:49:54.871795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3422): Terminating (SIGTERM) 00:49:54.914402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3425): Terminating (SIGTERM) 00:49:54.957210 --- ParallelTerminationStrategy: PID 3409 died... 00:49:54.977691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3409): Terminated: ok {rc=0} 00:49:55.025071 --- ParallelTerminationStrategy: PID 3410 died... 00:49:55.045177 run iperf3-srv_10.42.42.10(pid=3410): Terminated {rc=256} 00:49:55.091955 --- ParallelTerminationStrategy: PID 3411 died... 00:49:55.112025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3411): Terminated: ok {rc=0} 00:49:55.158916 --- ParallelTerminationStrategy: PID 3412 died... 00:49:55.178777 run iperf3-srv_10.42.42.10(pid=3412): Terminated {rc=256} 00:49:55.225656 --- ParallelTerminationStrategy: PID 3413 died... 00:49:55.245608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3413): Terminated: ok {rc=0} 00:49:55.292550 --- ParallelTerminationStrategy: PID 3414 died... 00:49:55.312557 run iperf3-srv_10.42.42.10(pid=3414): Terminated {rc=256} 00:49:55.359487 --- ParallelTerminationStrategy: PID 3415 died... 00:49:55.379517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3415): Terminated: ok {rc=0} 00:49:55.426762 --- ParallelTerminationStrategy: PID 3416 died... 00:49:55.446792 run iperf3-srv_10.42.42.10(pid=3416): Terminated {rc=256} 00:49:55.493799 --- ParallelTerminationStrategy: PID 3419 died... 00:49:55.513939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3419): Terminated: ok {rc=0} 00:49:55.561021 --- ParallelTerminationStrategy: PID 3422 died... 00:49:55.581053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3422): Terminated: ok {rc=0} 00:49:55.627916 --- ParallelTerminationStrategy: PID 3425 died... 00:49:55.647827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3425): Terminated: ok {rc=0} 00:49:55.738066 bus /gobi_4: Setting Powered False 00:49:56.839371 bus /gobi_4: Setting Powered False 00:49:57.959327 bus /gobi_1: Setting Powered False 00:49:59.058831 bus /gobi_1: Setting Powered False 00:50:00.176161 bus /gobi_0: Setting Powered False 00:50:01.287195 bus /gobi_0: Setting Powered False 00:50:02.412782 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:50:03.517701 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:03.529589 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:50:03.589673 tst ping.py: using LAC 17914 00:50:03.721059 tst ping.py: using RAC 64 00:50:03.851340 tst ping.py: using CellId 17914 00:50:03.982842 tst ping.py: using BVCI 17915 00:50:04.103003 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:04.114596 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:04.125847 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:04.137637 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:04.149680 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:04.161458 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:04.173489 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:04.185231 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:50:04.303181 tst ping.py:19: start network... 00:50:04.509631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:04.994303 run create_hlr_db(pid=3430): Launched 00:50:05.109104 bus /gobi_6: Setting Powered False 00:50:06.169204 run create_hlr_db(pid=3430): Terminated: ok {rc=0} 00:50:06.613305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3432): Launched 00:50:06.938994 run osmo-hlr_10.42.42.2(pid=3433): Launched 00:50:07.062710 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:07.623949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3435): Launched 00:50:07.947844 run osmo-stp_10.42.42.5(pid=3436): Launched 00:50:08.070748 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:50:08.629527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3438): Launched 00:50:08.752707 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:50:09.027995 run patchelf(pid=3439): Launched 00:50:09.207512 run osmo-stp_10.42.42.5(pid=3436): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3436)] 00:50:09.344903 run osmo-stp_10.42.42.5(pid=3436): stdout: | (launched: 2022-12-09_00:50:07.887310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:09.484099 run osmo-stp_10.42.42.5(pid=3436): stderr: | 20221209005008082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005008082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005008082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005008082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005008083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005008083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005008083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:09.622912 run osmo-stp_10.42.42.5(pid=3436): stdout: | (launched: 2022-12-09_00:50:07.887310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:09.755183 run osmo-stp_10.42.42.5(pid=3436): stderr: | 20221209005008082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005008082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005008082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005008082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005008083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005008083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005008083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:09.912139 run patchelf(pid=3439): Terminating (SIGINT) 00:50:10.093238 run patchelf(pid=3439): Terminated: ok {rc=0} 00:50:10.223740 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3436): Process ended prematurely: osmo-stp_10.42.42.5(pid=3436) [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3436)] [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 00:50:10.233323 tst ping.py:22: Test FAILED (6.7 sec) 00:50:10.261546 run osmo-hlr_10.42.42.2(pid=3433): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3433)] 00:50:10.312238 run osmo-hlr_10.42.42.2(pid=3433): stdout: | (launched: 2022-12-09_00:50:06.878190) 00:50:10.364637 run osmo-hlr_10.42.42.2(pid=3433): stderr: | 20221209005007080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005007080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005007080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005007081 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005007081 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005007081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005007096 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005007106 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005007106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005007106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:10.417267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3432): Terminating (SIGTERM) 00:50:10.460024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3435): Terminating (SIGTERM) 00:50:10.502493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3438): Terminating (SIGTERM) 00:50:10.545202 --- ParallelTerminationStrategy: PID 3432 died... 00:50:10.565439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3432): Terminated: ok {rc=0} 00:50:10.612486 --- ParallelTerminationStrategy: PID 3435 died... 00:50:10.632358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3435): Terminated: ok {rc=0} 00:50:10.678961 --- ParallelTerminationStrategy: PID 3438 died... 00:50:10.698854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3438): Terminated: ok {rc=0} 00:50:10.786536 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:50:11.874885 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:11.887205 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:50:11.950480 tst ping_idle_ping.py: using LAC 17915 00:50:12.080212 tst ping_idle_ping.py: using RAC 65 00:50:12.206662 tst ping_idle_ping.py: using CellId 17915 00:50:12.332652 tst ping_idle_ping.py: using BVCI 17916 00:50:12.450831 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:12.462502 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:12.473767 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:12.485012 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:12.496178 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:12.507483 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:12.518956 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:12.530242 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:50:12.651434 tst ping_idle_ping.py:24: start network... 00:50:12.870700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:13.376728 run create_hlr_db(pid=3440): Launched 00:50:13.502032 bus /gobi_6: Setting Powered False 00:50:14.562809 run create_hlr_db(pid=3440): Terminated: ok {rc=0} 00:50:14.986405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3442): Launched 00:50:15.290136 run osmo-hlr_10.42.42.2(pid=3443): Launched 00:50:15.405749 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:15.971230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3445): Launched 00:50:16.362615 run osmo-stp_10.42.42.5(pid=3446): Launched 00:50:16.564591 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:50:17.233793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3448): Launched 00:50:17.367318 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:50:17.644133 run patchelf(pid=3449): Launched 00:50:17.825415 run osmo-stp_10.42.42.5(pid=3446): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3446)] 00:50:17.963575 run osmo-stp_10.42.42.5(pid=3446): stdout: | (launched: 2022-12-09_00:50:16.297104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:18.103751 run osmo-stp_10.42.42.5(pid=3446): stderr: | 20221209005016540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005016540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005016540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005016542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005016542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005016542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005016543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:18.243889 run osmo-stp_10.42.42.5(pid=3446): stdout: | (launched: 2022-12-09_00:50:16.297104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:18.377381 run osmo-stp_10.42.42.5(pid=3446): stderr: | 20221209005016540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005016540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005016540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005016542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005016542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005016542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005016543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:18.535726 run patchelf(pid=3449): Terminating (SIGINT) 00:50:18.718303 run patchelf(pid=3449): Terminated: ok {rc=0} 00:50:18.849746 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3446): Process ended prematurely: osmo-stp_10.42.42.5(pid=3446) [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3446)] [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:50:18.859433 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 00:50:18.887719 run osmo-hlr_10.42.42.2(pid=3443): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3443)] 00:50:18.938182 run osmo-hlr_10.42.42.2(pid=3443): stdout: | (launched: 2022-12-09_00:50:15.233232) 00:50:18.990672 run osmo-hlr_10.42.42.2(pid=3443): stderr: | 20221209005015411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005015411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005015411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005015411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005015412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005015412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005015423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005015433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005015433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005015433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:19.043477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3442): Terminating (SIGTERM) 00:50:19.085925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3445): Terminating (SIGTERM) 00:50:19.127992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3448): Terminating (SIGTERM) 00:50:19.170503 --- ParallelTerminationStrategy: PID 3442 died... 00:50:19.190844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3442): Terminated: ok {rc=0} 00:50:19.237999 --- ParallelTerminationStrategy: PID 3445 died... 00:50:19.257976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3445): Terminated: ok {rc=0} 00:50:19.305257 --- ParallelTerminationStrategy: PID 3448 died... 00:50:19.325158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3448): Terminated: ok {rc=0} 00:50:19.413894 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:50:20.704727 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:20.711737 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:50:20.733246 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:50:20.769112 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:50:20.823740 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:50:20.845016 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:50:20.880127 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:50:21.439903 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:50:21.445242 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:21.456671 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:50:21.514755 tst switch_tch_pdch.py: using LAC 17916 00:50:21.642609 tst switch_tch_pdch.py: using RAC 66 00:50:21.771891 tst switch_tch_pdch.py: using CellId 17916 00:50:21.898513 tst switch_tch_pdch.py: using BVCI 17917 00:50:22.015905 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:22.027549 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:22.038984 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:22.050416 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:22.062169 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:22.073626 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:22.085179 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:22.096480 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:50:22.210520 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:50:22.325850 tst switch_tch_pdch.py:51: start network... 00:50:22.527263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:22.992222 run create_hlr_db(pid=3453): Launched 00:50:23.108012 bus /gobi_6: Setting Powered False 00:50:24.167649 run create_hlr_db(pid=3453): Terminated: ok {rc=0} 00:50:24.612152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3455): Launched 00:50:24.935409 run osmo-hlr_10.42.42.2(pid=3456): Launched 00:50:25.058745 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:25.615394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3458): Launched 00:50:25.938506 run osmo-stp_10.42.42.5(pid=3459): Launched 00:50:26.062328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:50:26.620453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3461): Launched 00:50:26.745465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:50:27.018505 run patchelf(pid=3462): Launched 00:50:27.198144 run osmo-stp_10.42.42.5(pid=3459): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3459)] 00:50:27.334755 run osmo-stp_10.42.42.5(pid=3459): stdout: | (launched: 2022-12-09_00:50:25.878096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:27.473526 run osmo-stp_10.42.42.5(pid=3459): stderr: | 20221209005026072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005026072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005026073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005026073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005026074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005026074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005026074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:27.611754 run osmo-stp_10.42.42.5(pid=3459): stdout: | (launched: 2022-12-09_00:50:25.878096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:27.743934 run osmo-stp_10.42.42.5(pid=3459): stderr: | 20221209005026072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005026072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005026073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005026073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005026074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005026074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005026074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:27.900722 run patchelf(pid=3462): Terminating (SIGINT) 00:50:28.082344 run patchelf(pid=3462): Terminated: ok {rc=0} 00:50:28.213314 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3459): Process ended prematurely: osmo-stp_10.42.42.5(pid=3459) [trial-2352↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3459)] [trial-2352↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:50:28.222715 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 00:50:28.250783 run osmo-hlr_10.42.42.2(pid=3456): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3456)] 00:50:28.300778 run osmo-hlr_10.42.42.2(pid=3456): stdout: | (launched: 2022-12-09_00:50:24.875118) 00:50:28.352766 run osmo-hlr_10.42.42.2(pid=3456): stderr: | 20221209005025075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005025075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005025075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005025075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005025075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005025075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005025087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005025095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005025096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005025096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:28.405115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3455): Terminating (SIGTERM) 00:50:28.447553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3458): Terminating (SIGTERM) 00:50:28.489699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3461): Terminating (SIGTERM) 00:50:28.531782 --- ParallelTerminationStrategy: PID 3455 died... 00:50:28.552038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3455): Terminated: ok {rc=0} 00:50:28.598689 --- ParallelTerminationStrategy: PID 3458 died... 00:50:28.618490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3458): Terminated: ok {rc=0} 00:50:28.664768 --- ParallelTerminationStrategy: PID 3461 died... 00:50:28.684529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3461): Terminated: ok {rc=0} 00:50:28.771791 bus /gobi_0: Setting Powered False 00:50:29.871266 bus /gobi_0: Setting Powered False 00:50:31.006609 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:50:32.251560 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:32.257648 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:50:32.282184 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:50:32.317237 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:50:32.369494 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:50:32.390981 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:50:32.426362 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:50:32.981742 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:50:32.987089 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:32.998631 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:50:33.055000 tst switch_tch_pdch.py: using LAC 17917 00:50:33.180331 tst switch_tch_pdch.py: using RAC 67 00:50:33.306296 tst switch_tch_pdch.py: using CellId 17917 00:50:33.430833 tst switch_tch_pdch.py: using BVCI 17918 00:50:33.548082 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:33.559425 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:33.570541 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:33.581826 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:33.592919 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:33.604153 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:33.615515 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:33.626820 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:50:33.741924 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:50:33.860569 tst switch_tch_pdch.py:51: start network... 00:50:34.079101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:34.552726 run create_hlr_db(pid=3466): Launched 00:50:34.683539 bus /gobi_6: Setting Powered False 00:50:35.760435 run create_hlr_db(pid=3466): Terminated: ok {rc=0} 00:50:36.178905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3468): Launched 00:50:36.498119 run osmo-hlr_10.42.42.2(pid=3469): Launched 00:50:36.618751 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:37.139443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3471): Launched 00:50:37.459329 run osmo-stp_10.42.42.5(pid=3472): Launched 00:50:37.581199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:50:38.105061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3474): Launched 00:50:38.226635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:50:38.497130 run patchelf(pid=3475): Launched 00:50:38.673807 run osmo-stp_10.42.42.5(pid=3472): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3472)] 00:50:38.809418 run osmo-stp_10.42.42.5(pid=3472): stdout: | (launched: 2022-12-09_00:50:37.400185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:38.946773 run osmo-stp_10.42.42.5(pid=3472): stderr: | 20221209005037592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005037592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005037592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005037592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005037595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005037595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005037595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:39.084347 run osmo-stp_10.42.42.5(pid=3472): stdout: | (launched: 2022-12-09_00:50:37.400185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:39.215553 run osmo-stp_10.42.42.5(pid=3472): stderr: | 20221209005037592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005037592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005037592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005037592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005037595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005037595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005037595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:39.371097 run patchelf(pid=3475): Terminating (SIGINT) 00:50:39.550447 run patchelf(pid=3475): Terminated: ok {rc=0} 00:50:39.679264 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3472): Process ended prematurely: osmo-stp_10.42.42.5(pid=3472) [trial-2352↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3472)] [trial-2352↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:50:39.688661 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 00:50:39.716520 run osmo-hlr_10.42.42.2(pid=3469): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3469)] 00:50:39.766755 run osmo-hlr_10.42.42.2(pid=3469): stdout: | (launched: 2022-12-09_00:50:36.438871) 00:50:39.819395 run osmo-hlr_10.42.42.2(pid=3469): stderr: | 20221209005036639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005036639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005036639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005036639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005036639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005036639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005036652 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005036660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005036660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005036660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:39.871721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3468): Terminating (SIGTERM) 00:50:39.913479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3471): Terminating (SIGTERM) 00:50:39.955609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3474): Terminating (SIGTERM) 00:50:39.997949 --- ParallelTerminationStrategy: PID 3468 died... 00:50:40.018092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3468): Terminated: ok {rc=0} 00:50:40.065073 --- ParallelTerminationStrategy: PID 3471 died... 00:50:40.084990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3471): Terminated: ok {rc=0} 00:50:40.131313 --- ParallelTerminationStrategy: PID 3474 died... 00:50:40.151019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3474): Terminated: ok {rc=0} 00:50:40.238786 bus /gobi_0: Setting Powered False 00:50:41.335990 bus /gobi_0: Setting Powered False 00:50:42.451533 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_sms:oc2g --------------------------------------------------------------------- 00:50:43.687062 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:43.691965 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 00:50:43.713417 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 00:50:43.720336 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 00:50:43.774534 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 00:50:43.796138 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 00:50:43.803136 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 00:50:44.339242 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 00:50:44.345759 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 00:50:44.357342 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 00:50:44.391918 tst mo_mt_sms.py: using LAC 17918 00:50:44.517092 tst mo_mt_sms.py: using RAC 68 00:50:44.641860 tst mo_mt_sms.py: using CellId 17918 00:50:44.767994 tst mo_mt_sms.py: using BVCI 17919 00:50:44.884602 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 00:50:44.996195 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 00:50:45.110082 tst mo_mt_sms.py:9: start nitb and bts... 00:50:45.310873 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:50:45.941700 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3479): Launched 00:50:46.254384 run osmo-nitb_10.42.42.2(pid=3480): Launched 00:50:46.443745 run osmo-nitb_10.42.42.2(pid=3480): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3480)] 00:50:46.581885 run osmo-nitb_10.42.42.2(pid=3480): stdout: | (launched: 2022-12-09_00:50:46.192560) 00:50:46.721673 run osmo-nitb_10.42.42.2(pid=3480): stderr: | (launched: 2022-12-09_00:50:46.237571) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:50:46.861482 run osmo-nitb_10.42.42.2(pid=3480): stdout: | (launched: 2022-12-09_00:50:46.192560) 00:50:46.995177 run osmo-nitb_10.42.42.2(pid=3480): stderr: | (launched: 2022-12-09_00:50:46.237571) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3480): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3480) [trial-2352↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3480)] 00:50:47.389835 tst osmo-nitb_10.42.42.2(pid=3480): stdout: | (launched: 2022-12-09_00:50:46.192560) 00:50:47.510679 tst osmo-nitb_10.42.42.2(pid=3480): stderr: | (launched: 2022-12-09_00:50:46.237571) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:50:47.653756 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3480): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3480) [trial-2352↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3480)] [trial-2352↪nitb_sms:oc2g↪mo_mt_sms.py:11] 00:50:47.661932 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 00:50:47.668499 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3479): Terminating (SIGTERM) 00:50:47.879497 --- ParallelTerminationStrategy: PID 3479 died... 00:50:47.900130 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3479): Terminated: ok {rc=0} 00:50:47.987921 bus /sierra_3: Setting Powered False 00:50:49.088207 bus /sierra_3: Setting Powered False 00:50:50.206347 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 sms:oc2g --------------------------------------------------------------------- 00:50:51.388806 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:51.394310 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 00:50:51.415837 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 00:50:51.443447 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 00:50:51.497401 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 00:50:51.518718 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 00:50:51.546324 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 00:50:52.092106 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 sms:oc2g mo_mt_sms.py ---------------------------------------------- 00:50:52.097507 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:52.108443 tst sms:oc2g: Using 1 x bts (candidates: 1) 00:50:52.143346 tst mo_mt_sms.py: using LAC 17919 00:50:52.268849 tst mo_mt_sms.py: using RAC 69 00:50:52.393514 tst mo_mt_sms.py: using CellId 17919 00:50:52.521419 tst mo_mt_sms.py: using BVCI 17920 00:50:52.637610 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:52.648400 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:52.659347 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:52.670336 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:52.681284 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:52.692112 tst sms:oc2g: Using 1 x modem (candidates: 2) 00:50:52.805296 tst sms:oc2g: Using 1 x modem (candidates: 2) 00:50:52.918899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:53.382200 run create_hlr_db(pid=3484): Launched 00:50:53.497891 bus /sierra_2: Setting Powered False 00:50:54.557762 run create_hlr_db(pid=3484): Terminated: ok {rc=0} 00:50:54.975866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3486): Launched 00:50:55.275949 run osmo-hlr_10.42.42.2(pid=3487): Launched 00:50:55.390867 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:55.922625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3489): Launched 00:50:56.222816 run osmo-stp_10.42.42.5(pid=3490): Launched 00:50:56.337673 run osmo-msc_10.42.42.6: Starting osmo-msc 00:50:56.879128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3492): Launched 00:50:57.180306 run osmo-msc_10.42.42.6(pid=3493): Launched 00:50:57.349485 run osmo-stp_10.42.42.5(pid=3490): ERR: Terminated: ERROR {rc=1} [trial-2352↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3490)] 00:50:57.476361 run osmo-stp_10.42.42.5(pid=3490): stdout: | (launched: 2022-12-09_00:50:56.167114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:57.603592 run osmo-stp_10.42.42.5(pid=3490): stderr: | 20221209005056337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005056337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005056338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005056338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005056338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005056339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005056339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:57.727972 run osmo-stp_10.42.42.5(pid=3490): stdout: | (launched: 2022-12-09_00:50:56.167114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:57.846834 run osmo-stp_10.42.42.5(pid=3490): stderr: | 20221209005056337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005056337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005056338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005056338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005056338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005056339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005056339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:57.989258 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3490): Process ended prematurely: osmo-stp_10.42.42.5(pid=3490) [trial-2352↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3490)] [trial-2352↪sms:oc2g↪mo_mt_sms.py:16] 00:50:57.997407 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 00:50:58.024098 run osmo-hlr_10.42.42.2(pid=3487): ERR: Terminated: ERROR {rc=237} [trial-2352↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3487)] 00:50:58.072227 run osmo-hlr_10.42.42.2(pid=3487): stdout: | (launched: 2022-12-09_00:50:55.220536) 00:50:58.122193 run osmo-hlr_10.42.42.2(pid=3487): stderr: | 20221209005055397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005055397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005055397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005055397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005055397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005055397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005055408 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005055416 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005055416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005055417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:58.191487 run osmo-msc_10.42.42.6(pid=3493): ERR: Terminated: ERROR {rc=2} [trial-2352↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3493)] 00:50:58.239504 run osmo-msc_10.42.42.6(pid=3493): stdout: | (launched: 2022-12-09_00:50:57.124390) 00:50:58.289200 run osmo-msc_10.42.42.6(pid=3493): stderr: | 20221209005057396 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005057397 DLGLOBAL DEBUG validating counter group 0x7f450ebc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005057397 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005057397 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005057397 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005057397 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005057399 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005057399 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005057400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005057400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:50:58.339184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3486): Terminating (SIGTERM) 00:50:58.379110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3489): Terminating (SIGTERM) 00:50:58.419502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3492): Terminating (SIGTERM) 00:50:58.459668 --- ParallelTerminationStrategy: PID 3486 died... 00:50:58.478771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3486): Terminated: ok {rc=0} 00:50:58.523064 --- ParallelTerminationStrategy: PID 3489 died... 00:50:58.541639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3489): Terminated: ok {rc=0} 00:50:58.586449 --- ParallelTerminationStrategy: PID 3492 died... 00:50:58.605177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3492): Terminated: ok {rc=0} 00:50:58.690668 bus /sierra_3: Setting Powered False 00:50:59.788430 bus /sierra_3: Setting Powered False 00:51:00.913377 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_ussd:oc2g --------------------------------------------------------------------- 00:51:02.133717 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:51:02.137852 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 00:51:02.180098 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 00:51:02.191483 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 00:51:02.229888 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 00:51:02.261732 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 00:51:02.270370 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 00:51:02.775979 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2352 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 00:51:02.783483 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 00:51:02.795331 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 00:51:02.835618 tst assert_extension.py: using LAC 17920 00:51:02.962635 tst assert_extension.py: using RAC 70 00:51:03.087591 tst assert_extension.py: using CellId 17920 00:51:03.211888 tst assert_extension.py: using BVCI 17921 00:51:03.323929 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 00:51:03.437789 tst assert_extension.py:10: start nitb and bts... 00:51:03.638506 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:51:04.247361 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3498): Launched 00:51:04.547503 run osmo-nitb_10.42.42.2(pid=3499): Launched 00:51:04.713809 run osmo-nitb_10.42.42.2(pid=3499): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3499)] 00:51:04.848184 run osmo-nitb_10.42.42.2(pid=3499): stdout: | (launched: 2022-12-09_00:51:04.491914) 00:51:04.983818 run osmo-nitb_10.42.42.2(pid=3499): stderr: | (launched: 2022-12-09_00:51:04.536194) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:51:05.120223 run osmo-nitb_10.42.42.2(pid=3499): stdout: | (launched: 2022-12-09_00:51:04.491914) 00:51:05.250280 run osmo-nitb_10.42.42.2(pid=3499): stderr: | (launched: 2022-12-09_00:51:04.536194) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3499): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3499) [trial-2352↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3499)] 00:51:05.660771 tst osmo-nitb_10.42.42.2(pid=3499): stdout: | (launched: 2022-12-09_00:51:04.491914) 00:51:05.781519 tst osmo-nitb_10.42.42.2(pid=3499): stderr: | (launched: 2022-12-09_00:51:04.536194) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:51:05.924492 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3499): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3499) [trial-2352↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3499)] [trial-2352↪nitb_ussd:oc2g↪assert_extension.py:12] 00:51:05.932752 tst assert_extension.py:12: Test FAILED (3.1 sec) 00:51:05.939461 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3498): Terminating (SIGTERM) 00:51:06.150746 --- ParallelTerminationStrategy: PID 3498 died... 00:51:06.171943 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3498): Terminated: ok {rc=0} 00:51:06.259154 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 ussd:oc2g --------------------------------------------------------------------- 00:51:07.419863 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:51:07.423920 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 00:51:07.445052 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 00:51:07.471939 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 00:51:07.508315 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 00:51:07.529665 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 00:51:07.557078 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 00:51:08.081362 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2352 ussd:oc2g assert_extension.py ---------------------------------------------- 00:51:08.086478 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:51:08.097365 tst ussd:oc2g: Using 1 x bts (candidates: 1) 00:51:08.131533 tst assert_extension.py: using LAC 17921 00:51:08.249242 tst assert_extension.py: using RAC 71 00:51:08.367076 tst assert_extension.py: using CellId 17921 00:51:08.485824 tst assert_extension.py: using BVCI 17922 00:51:08.595804 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:51:08.606493 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:51:08.616779 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:51:08.627278 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:51:08.637786 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:51:08.648181 tst ussd:oc2g: Using 1 x modem (candidates: 1) 00:51:08.764637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:09.263891 run create_hlr_db(pid=3504): Launched 00:51:09.395212 bus /sierra_2: Setting Powered False 00:51:10.459709 run create_hlr_db(pid=3504): Terminated: ok {rc=0} 00:51:10.889092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3506): Launched 00:51:11.188861 run osmo-hlr_10.42.42.2(pid=3507): Launched 00:51:11.303660 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:11.840465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3509): Launched 00:51:12.141411 run osmo-stp_10.42.42.5(pid=3510): Launched 00:51:12.256323 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:12.797475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3512): Launched 00:51:13.098013 run osmo-msc_10.42.42.6(pid=3513): Launched 00:51:13.265210 run osmo-stp_10.42.42.5(pid=3510): ERR: Terminated: ERROR {rc=1} [trial-2352↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3510)] 00:51:13.391642 run osmo-stp_10.42.42.5(pid=3510): stdout: | (launched: 2022-12-09_00:51:12.084789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:13.519344 run osmo-stp_10.42.42.5(pid=3510): stderr: | 20221209005112255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005112256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005112256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005112256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005112257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005112257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005112257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:13.644468 run osmo-stp_10.42.42.5(pid=3510): stdout: | (launched: 2022-12-09_00:51:12.084789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:13.763321 run osmo-stp_10.42.42.5(pid=3510): stderr: | 20221209005112255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005112256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005112256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005112256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005112257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005112257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005112257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:13.905583 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3510): Process ended prematurely: osmo-stp_10.42.42.5(pid=3510) [trial-2352↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3510)] [trial-2352↪ussd:oc2g↪assert_extension.py:17] 00:51:13.913919 tst assert_extension.py:17: Test FAILED (5.8 sec) 00:51:13.940556 run osmo-hlr_10.42.42.2(pid=3507): ERR: Terminated: ERROR {rc=237} [trial-2352↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3507)] 00:51:13.988522 run osmo-hlr_10.42.42.2(pid=3507): stdout: | (launched: 2022-12-09_00:51:11.133326) 00:51:14.038153 run osmo-hlr_10.42.42.2(pid=3507): stderr: | 20221209005111311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005111311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005111311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005111311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005111311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005111311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005111323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005111332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005111332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005111332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:14.107866 run osmo-msc_10.42.42.6(pid=3513): ERR: Terminated: ERROR {rc=2} [trial-2352↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3513)] 00:51:14.156019 run osmo-msc_10.42.42.6(pid=3513): stdout: | (launched: 2022-12-09_00:51:13.042330) 00:51:14.205778 run osmo-msc_10.42.42.6(pid=3513): stderr: | 20221209005113314 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005113315 DLGLOBAL DEBUG validating counter group 0x7f4ae9856c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005113315 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005113315 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005113315 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005113315 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005113317 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005113318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005113318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005113318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:14.256087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3506): Terminating (SIGTERM) 00:51:14.295898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3509): Terminating (SIGTERM) 00:51:14.335865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3512): Terminating (SIGTERM) 00:51:14.375963 --- ParallelTerminationStrategy: PID 3506 died... 00:51:14.395066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3506): Terminated: ok {rc=0} 00:51:14.439663 --- ParallelTerminationStrategy: PID 3509 died... 00:51:14.458571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3509): Terminated: ok {rc=0} 00:51:14.502973 --- ParallelTerminationStrategy: PID 3512 died... 00:51:14.521619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3512): Terminated: ok {rc=0} 00:51:14.606680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:51:15.800895 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:51:15.808426 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:51:15.834062 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:51:15.865880 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:51:15.921603 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:51:15.943983 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:51:15.972701 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:51:16.549405 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:51:16.627069 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:16.639506 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:51:16.698559 tst mo_mt_call.py: using LAC 17922 00:51:16.850111 tst mo_mt_call.py: using RAC 72 00:51:17.005118 tst mo_mt_call.py: using CellId 17922 00:51:17.137352 tst mo_mt_call.py: using BVCI 17923 00:51:17.259257 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:17.271558 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:17.283737 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:17.296350 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:17.309593 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:17.321923 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:51:17.441600 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:51:17.557980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:18.030886 run create_hlr_db(pid=3518): Launched 00:51:18.147877 bus /sierra_2: Setting Powered False 00:51:19.209438 run create_hlr_db(pid=3518): Terminated: ok {rc=0} 00:51:19.657979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3520): Launched 00:51:19.988410 run osmo-hlr_10.42.42.2(pid=3521): Launched 00:51:20.115171 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:20.685338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3523): Launched 00:51:21.014619 run osmo-stp_10.42.42.5(pid=3524): Launched 00:51:21.139719 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:21.735294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3526): Launched 00:51:22.063943 run osmo-msc_10.42.42.6(pid=3527): Launched 00:51:22.246936 run osmo-stp_10.42.42.5(pid=3524): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3524)] 00:51:22.384918 run osmo-stp_10.42.42.5(pid=3524): stdout: | (launched: 2022-12-09_00:51:20.953900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:22.523428 run osmo-stp_10.42.42.5(pid=3524): stderr: | 20221209005121147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005121147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005121147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005121147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005121150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005121150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005121150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:22.660866 run osmo-stp_10.42.42.5(pid=3524): stdout: | (launched: 2022-12-09_00:51:20.953900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:22.791106 run osmo-stp_10.42.42.5(pid=3524): stderr: | 20221209005121147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005121147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005121147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005121147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005121150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005121150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005121150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:22.946808 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3524): Process ended prematurely: osmo-stp_10.42.42.5(pid=3524) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3524)] [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:51:22.956518 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:51:22.984694 run osmo-hlr_10.42.42.2(pid=3521): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3521)] 00:51:23.035732 run osmo-hlr_10.42.42.2(pid=3521): stdout: | (launched: 2022-12-09_00:51:19.927837) 00:51:23.088134 run osmo-hlr_10.42.42.2(pid=3521): stderr: | 20221209005120127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005120127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005120127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005120127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005120127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005120127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005120139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005120150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005120150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005120150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:23.161266 run osmo-msc_10.42.42.6(pid=3527): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3527)] 00:51:23.211977 run osmo-msc_10.42.42.6(pid=3527): stdout: | (launched: 2022-12-09_00:51:22.003505) 00:51:23.264229 run osmo-msc_10.42.42.6(pid=3527): stderr: | 20221209005122329 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005122329 DLGLOBAL DEBUG validating counter group 0x7f09b4712c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005122329 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005122329 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005122330 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005122330 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005122331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005122332 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005122332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005122332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:23.317052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3520): Terminating (SIGTERM) 00:51:23.359285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3523): Terminating (SIGTERM) 00:51:23.401640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3526): Terminating (SIGTERM) 00:51:23.444509 --- ParallelTerminationStrategy: PID 3520 died... 00:51:23.465188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3520): Terminated: ok {rc=0} 00:51:23.512368 --- ParallelTerminationStrategy: PID 3523 died... 00:51:23.532669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3523): Terminated: ok {rc=0} 00:51:23.579923 --- ParallelTerminationStrategy: PID 3526 died... 00:51:23.600003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3526): Terminated: ok {rc=0} 00:51:23.689156 bus /sierra_3: Setting Powered False 00:51:24.789491 bus /sierra_3: Setting Powered False 00:51:25.906452 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:51:27.056786 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:27.069285 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:51:27.127600 tst mo_mt_call_osmux.py: using LAC 17923 00:51:27.257930 tst mo_mt_call_osmux.py: using RAC 73 00:51:27.386125 tst mo_mt_call_osmux.py: using CellId 17923 00:51:27.514593 tst mo_mt_call_osmux.py: using BVCI 17924 00:51:27.635656 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:27.647292 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:27.658765 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:27.670205 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:27.681606 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:27.693035 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:51:27.808567 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:51:27.929806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:28.439038 run create_hlr_db(pid=3529): Launched 00:51:28.572531 bus /sierra_2: Setting Powered False 00:51:29.637166 run create_hlr_db(pid=3529): Terminated: ok {rc=0} 00:51:30.073711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3531): Launched 00:51:30.380057 run osmo-hlr_10.42.42.2(pid=3532): Launched 00:51:30.496854 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:31.086323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3534): Launched 00:51:31.433757 run osmo-stp_10.42.42.5(pid=3535): Launched 00:51:31.652720 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:32.381136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3537): Launched 00:51:32.709521 run osmo-msc_10.42.42.6(pid=3538): Launched 00:51:32.891892 run osmo-stp_10.42.42.5(pid=3535): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3535)] 00:51:33.028734 run osmo-stp_10.42.42.5(pid=3535): stdout: | (launched: 2022-12-09_00:51:31.371152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:33.166708 run osmo-stp_10.42.42.5(pid=3535): stderr: | 20221209005131764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005131764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005131764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005131773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005131773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005131773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005131773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:33.303535 run osmo-stp_10.42.42.5(pid=3535): stdout: | (launched: 2022-12-09_00:51:31.371152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:33.433727 run osmo-stp_10.42.42.5(pid=3535): stderr: | 20221209005131764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005131764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005131764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005131773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005131773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005131773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005131773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:33.590044 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3535): Process ended prematurely: osmo-stp_10.42.42.5(pid=3535) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3535)] [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:51:33.599566 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 00:51:33.628226 run osmo-hlr_10.42.42.2(pid=3532): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3532)] 00:51:33.679496 run osmo-hlr_10.42.42.2(pid=3532): stdout: | (launched: 2022-12-09_00:51:30.323344) 00:51:33.731630 run osmo-hlr_10.42.42.2(pid=3532): stderr: | 20221209005130503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005130503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005130503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005130503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005130503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005130503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005130517 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005130527 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005130528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005130528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:33.804342 run osmo-msc_10.42.42.6(pid=3538): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3538)] 00:51:33.854735 run osmo-msc_10.42.42.6(pid=3538): stdout: | (launched: 2022-12-09_00:51:32.648866) 00:51:33.906792 run osmo-msc_10.42.42.6(pid=3538): stderr: | 20221209005132974 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005132974 DLGLOBAL DEBUG validating counter group 0x7f755b570c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005132975 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005132975 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005132975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005132975 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005132977 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005132977 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005132977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005132977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:33.959593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3531): Terminating (SIGTERM) 00:51:34.001442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3534): Terminating (SIGTERM) 00:51:34.043282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3537): Terminating (SIGTERM) 00:51:34.085405 --- ParallelTerminationStrategy: PID 3531 died... 00:51:34.105608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3531): Terminated: ok {rc=0} 00:51:34.152530 --- ParallelTerminationStrategy: PID 3534 died... 00:51:34.172460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3534): Terminated: ok {rc=0} 00:51:34.219453 --- ParallelTerminationStrategy: PID 3537 died... 00:51:34.239329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3537): Terminated: ok {rc=0} 00:51:34.328697 bus /sierra_3: Setting Powered False 00:51:35.427982 bus /sierra_3: Setting Powered False 00:51:36.544475 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:51:37.783169 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:51:37.790202 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:51:37.811447 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:51:37.838806 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:51:37.891115 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:51:37.912117 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:51:37.939195 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:51:38.492202 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:51:38.545019 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:38.556523 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:51:38.613089 tst mo_mt_call.py: using LAC 17924 00:51:38.740278 tst mo_mt_call.py: using RAC 74 00:51:38.866997 tst mo_mt_call.py: using CellId 17924 00:51:38.995750 tst mo_mt_call.py: using BVCI 17925 00:51:39.114774 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:39.126400 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:39.137764 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:39.149073 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:39.160345 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:39.171705 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:39.287991 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:39.402812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:39.878156 run create_hlr_db(pid=3543): Launched 00:51:39.997439 bus /sierra_2: Setting Powered False 00:51:41.058819 run create_hlr_db(pid=3543): Terminated: ok {rc=0} 00:51:41.508188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Launched 00:51:41.838693 run osmo-hlr_10.42.42.2(pid=3546): Launched 00:51:41.964490 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:42.531095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Launched 00:51:42.860084 run osmo-stp_10.42.42.5(pid=3549): Launched 00:51:42.985584 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:43.578348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Launched 00:51:43.908390 run osmo-msc_10.42.42.6(pid=3552): Launched 00:51:44.091567 run osmo-stp_10.42.42.5(pid=3549): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] 00:51:44.229543 run osmo-stp_10.42.42.5(pid=3549): stdout: | (launched: 2022-12-09_00:51:42.799546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:44.367589 run osmo-stp_10.42.42.5(pid=3549): stderr: | 20221209005142991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005142991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005142992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005142992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005142994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005142994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005142995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:44.505494 run osmo-stp_10.42.42.5(pid=3549): stdout: | (launched: 2022-12-09_00:51:42.799546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:44.635602 run osmo-stp_10.42.42.5(pid=3549): stderr: | 20221209005142991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005142991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005142992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005142992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005142994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005142994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005142995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:44.791439 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3549): Process ended prematurely: osmo-stp_10.42.42.5(pid=3549) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:51:44.800782 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:51:44.829441 run osmo-hlr_10.42.42.2(pid=3546): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3546)] 00:51:44.880219 run osmo-hlr_10.42.42.2(pid=3546): stdout: | (launched: 2022-12-09_00:51:41.778283) 00:51:44.932749 run osmo-hlr_10.42.42.2(pid=3546): stderr: | 20221209005141977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005141977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005141977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005141977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005141977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005141977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005141990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005141999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005141999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005141999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:45.006050 run osmo-msc_10.42.42.6(pid=3552): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3552)] 00:51:45.056663 run osmo-msc_10.42.42.6(pid=3552): stdout: | (launched: 2022-12-09_00:51:43.847602) 00:51:45.109239 run osmo-msc_10.42.42.6(pid=3552): stderr: | 20221209005144172 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005144172 DLGLOBAL DEBUG validating counter group 0x7fc1e98cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005144172 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005144172 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005144172 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005144172 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005144174 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005144174 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005144175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005144175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:45.161886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Terminating (SIGTERM) 00:51:45.203670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Terminating (SIGTERM) 00:51:45.246011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Terminating (SIGTERM) 00:51:45.288406 --- ParallelTerminationStrategy: PID 3545 died... 00:51:45.308102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Terminated: ok {rc=0} 00:51:45.355352 --- ParallelTerminationStrategy: PID 3548 died... 00:51:45.375167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Terminated: ok {rc=0} 00:51:45.421872 --- ParallelTerminationStrategy: PID 3551 died... 00:51:45.441647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Terminated: ok {rc=0} 00:51:45.530580 bus /sierra_3: Setting Powered False 00:51:46.628432 bus /sierra_3: Setting Powered False 00:51:47.747663 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:51:48.896195 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:48.907874 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:51:48.964302 tst mo_mt_call_osmux.py: using LAC 17925 00:51:49.088163 tst mo_mt_call_osmux.py: using RAC 75 00:51:49.208490 tst mo_mt_call_osmux.py: using CellId 17925 00:51:49.326640 tst mo_mt_call_osmux.py: using BVCI 17926 00:51:49.438941 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:49.450046 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:49.460784 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:49.471838 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:49.482996 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:49.494130 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:49.609374 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:49.729725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:50.203233 run create_hlr_db(pid=3554): Launched 00:51:50.319258 bus /sierra_2: Setting Powered False 00:51:51.379557 run create_hlr_db(pid=3554): Terminated: ok {rc=0} 00:51:51.826045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3556): Launched 00:51:52.135345 run osmo-hlr_10.42.42.2(pid=3557): Launched 00:51:52.251406 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:52.790278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3559): Launched 00:51:53.096687 run osmo-stp_10.42.42.5(pid=3560): Launched 00:51:53.213897 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:53.764881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3562): Launched 00:51:54.072154 run osmo-msc_10.42.42.6(pid=3563): Launched 00:51:54.243867 run osmo-stp_10.42.42.5(pid=3560): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3560)] 00:51:54.372881 run osmo-stp_10.42.42.5(pid=3560): stdout: | (launched: 2022-12-09_00:51:53.039773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:54.502486 run osmo-stp_10.42.42.5(pid=3560): stderr: | 20221209005153211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005153211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005153211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005153211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005153214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005153214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005153214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:54.629372 run osmo-stp_10.42.42.5(pid=3560): stdout: | (launched: 2022-12-09_00:51:53.039773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:54.750389 run osmo-stp_10.42.42.5(pid=3560): stderr: | 20221209005153211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005153211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005153211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005153211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005153214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005153214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005153214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:54.895091 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3560): Process ended prematurely: osmo-stp_10.42.42.5(pid=3560) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3560)] [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:51:54.903995 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:51:54.931200 run osmo-hlr_10.42.42.2(pid=3557): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3557)] 00:51:54.979268 run osmo-hlr_10.42.42.2(pid=3557): stdout: | (launched: 2022-12-09_00:51:52.078969) 00:51:55.028909 run osmo-hlr_10.42.42.2(pid=3557): stderr: | 20221209005152256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005152256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005152256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005152256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005152256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005152256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005152268 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005152277 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005152277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005152277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:55.098142 run osmo-msc_10.42.42.6(pid=3563): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3563)] 00:51:55.146149 run osmo-msc_10.42.42.6(pid=3563): stdout: | (launched: 2022-12-09_00:51:54.015233) 00:51:55.195551 run osmo-msc_10.42.42.6(pid=3563): stderr: | 20221209005154290 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005154290 DLGLOBAL DEBUG validating counter group 0x7ff37cb85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005154290 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005154291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005154291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005154291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005154293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005154293 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005154293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005154293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:55.245503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3556): Terminating (SIGTERM) 00:51:55.285308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3559): Terminating (SIGTERM) 00:51:55.325204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3562): Terminating (SIGTERM) 00:51:55.365481 --- ParallelTerminationStrategy: PID 3556 died... 00:51:55.384640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3556): Terminated: ok {rc=0} 00:51:55.429108 --- ParallelTerminationStrategy: PID 3559 died... 00:51:55.447711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3559): Terminated: ok {rc=0} 00:51:55.492052 --- ParallelTerminationStrategy: PID 3562 died... 00:51:55.510716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3562): Terminated: ok {rc=0} 00:51:55.596748 bus /sierra_3: Setting Powered False 00:51:56.696536 bus /sierra_3: Setting Powered False 00:51:57.813615 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:51:59.044132 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:51:59.050332 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:51:59.070890 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:51:59.097738 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:51:59.150066 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:51:59.170900 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:51:59.197159 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:51:59.745804 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:51:59.794903 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:59.805791 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:51:59.861222 tst mo_mt_call.py: using LAC 17926 00:51:59.981203 tst mo_mt_call.py: using RAC 76 00:52:00.102689 tst mo_mt_call.py: using CellId 17926 00:52:00.225120 tst mo_mt_call.py: using BVCI 17927 00:52:00.338318 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:52:00.349369 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:52:00.360050 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:52:00.370992 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:52:00.381999 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:52:00.393016 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:52:00.516086 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:52:00.635651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:01.158965 run create_hlr_db(pid=3568): Launched 00:52:01.328624 bus /sierra_2: Setting Powered False 00:52:02.389456 run create_hlr_db(pid=3568): Terminated: ok {rc=0} 00:52:02.857586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Launched 00:52:03.187105 run osmo-hlr_10.42.42.2(pid=3571): Launched 00:52:03.312274 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:03.881209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Launched 00:52:04.210581 run osmo-stp_10.42.42.5(pid=3574): Launched 00:52:04.336022 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:04.930851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Launched 00:52:05.259551 run osmo-msc_10.42.42.6(pid=3577): Launched 00:52:05.442890 run osmo-stp_10.42.42.5(pid=3574): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] 00:52:05.581097 run osmo-stp_10.42.42.5(pid=3574): stdout: | (launched: 2022-12-09_00:52:04.149990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:05.718704 run osmo-stp_10.42.42.5(pid=3574): stderr: | 20221209005204346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005204347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005204347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005204347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005204348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005204348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005204348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:05.855876 run osmo-stp_10.42.42.5(pid=3574): stdout: | (launched: 2022-12-09_00:52:04.149990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:05.986722 run osmo-stp_10.42.42.5(pid=3574): stderr: | 20221209005204346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005204347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005204347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005204347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005204348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005204348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005204348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:06.142658 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3574): Process ended prematurely: osmo-stp_10.42.42.5(pid=3574) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:52:06.152156 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:52:06.180447 run osmo-hlr_10.42.42.2(pid=3571): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3571)] 00:52:06.231108 run osmo-hlr_10.42.42.2(pid=3571): stdout: | (launched: 2022-12-09_00:52:03.126527) 00:52:06.283514 run osmo-hlr_10.42.42.2(pid=3571): stderr: | 20221209005203326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005203326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005203326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005203326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005203326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005203326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005203338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005203347 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005203347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005203347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:06.356706 run osmo-msc_10.42.42.6(pid=3577): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3577)] 00:52:06.407227 run osmo-msc_10.42.42.6(pid=3577): stdout: | (launched: 2022-12-09_00:52:05.199051) 00:52:06.459532 run osmo-msc_10.42.42.6(pid=3577): stderr: | 20221209005205523 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005205523 DLGLOBAL DEBUG validating counter group 0x7f349b2f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005205523 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005205523 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005205523 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005205524 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005205525 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005205526 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005205526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005205526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:06.512720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Terminating (SIGTERM) 00:52:06.555087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Terminating (SIGTERM) 00:52:06.597558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Terminating (SIGTERM) 00:52:06.640008 --- ParallelTerminationStrategy: PID 3570 died... 00:52:06.660191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Terminated: ok {rc=0} 00:52:06.707043 --- ParallelTerminationStrategy: PID 3573 died... 00:52:06.726961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Terminated: ok {rc=0} 00:52:06.773702 --- ParallelTerminationStrategy: PID 3576 died... 00:52:06.793533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Terminated: ok {rc=0} 00:52:06.882223 bus /sierra_3: Setting Powered False 00:52:07.980472 bus /sierra_3: Setting Powered False 00:52:09.100475 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:52:10.248378 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:52:10.263798 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:52:10.322291 tst mo_mt_call_osmux.py: using LAC 17927 00:52:10.452126 tst mo_mt_call_osmux.py: using RAC 77 00:52:10.582489 tst mo_mt_call_osmux.py: using CellId 17927 00:52:10.712942 tst mo_mt_call_osmux.py: using BVCI 17928 00:52:10.831497 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:52:10.843273 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:52:10.854729 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:52:10.866387 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:52:10.878039 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:52:10.889535 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:52:11.009618 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:52:11.125668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:11.600250 run create_hlr_db(pid=3579): Launched 00:52:11.718163 bus /sierra_2: Setting Powered False 00:52:12.777852 run create_hlr_db(pid=3579): Terminated: ok {rc=0} 00:52:13.224882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3581): Launched 00:52:13.555225 run osmo-hlr_10.42.42.2(pid=3582): Launched 00:52:13.681932 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:14.250402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3584): Launched 00:52:14.573072 run osmo-stp_10.42.42.5(pid=3585): Launched 00:52:14.691407 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:15.242112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3587): Launched 00:52:15.547711 run osmo-msc_10.42.42.6(pid=3588): Launched 00:52:15.717833 run osmo-stp_10.42.42.5(pid=3585): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3585)] 00:52:15.872738 run osmo-stp_10.42.42.5(pid=3585): stdout: | (launched: 2022-12-09_00:52:14.516332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:16.052910 run osmo-stp_10.42.42.5(pid=3585): stderr: | 20221209005214687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005214687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005214688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005214688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005214689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005214689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005214689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:16.195525 run osmo-stp_10.42.42.5(pid=3585): stdout: | (launched: 2022-12-09_00:52:14.516332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:16.331843 run osmo-stp_10.42.42.5(pid=3585): stderr: | 20221209005214687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005214687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005214688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005214688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005214689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005214689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005214689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:16.495138 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3585): Process ended prematurely: osmo-stp_10.42.42.5(pid=3585) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3585)] [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:52:16.505920 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:52:16.535956 run osmo-hlr_10.42.42.2(pid=3582): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3582)] 00:52:16.589107 run osmo-hlr_10.42.42.2(pid=3582): stdout: | (launched: 2022-12-09_00:52:13.494432) 00:52:16.643881 run osmo-hlr_10.42.42.2(pid=3582): stderr: | 20221209005213697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005213697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005213697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005213697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005213697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005213697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005213709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005213718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005213718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005213718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:16.721332 run osmo-msc_10.42.42.6(pid=3588): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3588)] 00:52:16.773582 run osmo-msc_10.42.42.6(pid=3588): stdout: | (launched: 2022-12-09_00:52:15.491214) 00:52:16.826976 run osmo-msc_10.42.42.6(pid=3588): stderr: | 20221209005215764 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005215764 DLGLOBAL DEBUG validating counter group 0x7f2d4365ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005215764 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005215764 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005215765 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005215765 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005215767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005215767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005215767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005215767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:16.882611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3581): Terminating (SIGTERM) 00:52:16.925815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3584): Terminating (SIGTERM) 00:52:16.969836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3587): Terminating (SIGTERM) 00:52:17.013964 --- ParallelTerminationStrategy: PID 3581 died... 00:52:17.035467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3581): Terminated: ok {rc=0} 00:52:17.085584 --- ParallelTerminationStrategy: PID 3584 died... 00:52:17.105937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3584): Terminated: ok {rc=0} 00:52:17.153639 --- ParallelTerminationStrategy: PID 3587 died... 00:52:17.173912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3587): Terminated: ok {rc=0} 00:52:17.264810 bus /sierra_3: Setting Powered False 00:52:18.364459 bus /sierra_3: Setting Powered False 00:52:19.480771 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 00:52:20.717312 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:52:20.724380 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 00:52:20.746032 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 00:52:20.773922 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 00:52:20.827489 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 00:52:20.848818 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 00:52:20.876430 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 00:52:21.428432 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 00:52:21.481619 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:21.493412 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:52:21.551807 tst mo_mt_call.py: using LAC 17928 00:52:21.681274 tst mo_mt_call.py: using RAC 78 00:52:21.810731 tst mo_mt_call.py: using CellId 17928 00:52:21.941260 tst mo_mt_call.py: using BVCI 17929 00:52:22.062246 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:22.073820 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:22.085110 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:22.096600 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:22.108101 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:22.119590 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:52:22.235385 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:52:22.357043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:22.865647 run create_hlr_db(pid=3593): Launched 00:52:22.998177 bus /sierra_2: Setting Powered False 00:52:24.064031 run create_hlr_db(pid=3593): Terminated: ok {rc=0} 00:52:24.501595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3595): Launched 00:52:24.809242 run osmo-hlr_10.42.42.2(pid=3596): Launched 00:52:24.925951 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:25.451654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3598): Launched 00:52:25.757936 run osmo-stp_10.42.42.5(pid=3599): Launched 00:52:25.875141 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:26.429010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3601): Launched 00:52:26.735410 run osmo-msc_10.42.42.6(pid=3602): Launched 00:52:26.906833 run osmo-stp_10.42.42.5(pid=3599): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3599)] 00:52:27.035956 run osmo-stp_10.42.42.5(pid=3599): stdout: | (launched: 2022-12-09_00:52:25.701264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:27.165350 run osmo-stp_10.42.42.5(pid=3599): stderr: | 20221209005225873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005225873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005225874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005225874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005225875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005225875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005225875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:27.293083 run osmo-stp_10.42.42.5(pid=3599): stdout: | (launched: 2022-12-09_00:52:25.701264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:27.414132 run osmo-stp_10.42.42.5(pid=3599): stderr: | 20221209005225873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005225873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005225874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005225874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005225875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005225875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005225875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:27.559914 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3599): Process ended prematurely: osmo-stp_10.42.42.5(pid=3599) [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3599)] [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 00:52:27.568905 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:52:27.596205 run osmo-hlr_10.42.42.2(pid=3596): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3596)] 00:52:27.644661 run osmo-hlr_10.42.42.2(pid=3596): stdout: | (launched: 2022-12-09_00:52:24.752317) 00:52:27.695100 run osmo-hlr_10.42.42.2(pid=3596): stderr: | 20221209005224930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005224930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005224930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005224930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005224930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005224930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005224943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005224954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005224954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005224954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:27.765709 run osmo-msc_10.42.42.6(pid=3602): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3602)] 00:52:27.814400 run osmo-msc_10.42.42.6(pid=3602): stdout: | (launched: 2022-12-09_00:52:26.678770) 00:52:27.864797 run osmo-msc_10.42.42.6(pid=3602): stderr: | 20221209005226950 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005226950 DLGLOBAL DEBUG validating counter group 0x7f29f0c9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005226950 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005226950 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005226950 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005226951 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005226954 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005226954 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005226955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005226955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:27.915646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3595): Terminating (SIGTERM) 00:52:27.955828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3598): Terminating (SIGTERM) 00:52:27.996178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3601): Terminating (SIGTERM) 00:52:28.036576 --- ParallelTerminationStrategy: PID 3595 died... 00:52:28.056277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3595): Terminated: ok {rc=0} 00:52:28.101532 --- ParallelTerminationStrategy: PID 3598 died... 00:52:28.120336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3598): Terminated: ok {rc=0} 00:52:28.165334 --- ParallelTerminationStrategy: PID 3601 died... 00:52:28.184098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3601): Terminated: ok {rc=0} 00:52:28.271653 bus /sierra_3: Setting Powered False 00:52:29.371597 bus /sierra_3: Setting Powered False 00:52:30.487050 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 00:52:31.658920 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:31.674886 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:52:31.743230 tst mo_mt_call_osmux.py: using LAC 17929 00:52:31.866717 tst mo_mt_call_osmux.py: using RAC 79 00:52:31.996596 tst mo_mt_call_osmux.py: using CellId 17929 00:52:32.121079 tst mo_mt_call_osmux.py: using BVCI 17930 00:52:32.253086 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:32.266141 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:32.279084 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:32.292254 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:32.304148 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:32.317728 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:52:32.435155 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:52:32.551944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:33.064429 run create_hlr_db(pid=3604): Launched 00:52:33.197563 bus /sierra_2: Setting Powered False 00:52:34.262784 run create_hlr_db(pid=3604): Terminated: ok {rc=0} 00:52:34.722160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3606): Launched 00:52:35.051307 run osmo-hlr_10.42.42.2(pid=3607): Launched 00:52:35.176052 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:35.742664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3610): Launched 00:52:36.073293 run osmo-stp_10.42.42.5(pid=3613): Launched 00:52:36.197547 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:36.790978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3615): Launched 00:52:37.119817 run osmo-msc_10.42.42.6(pid=3616): Launched 00:52:37.302787 run osmo-stp_10.42.42.5(pid=3613): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3613)] 00:52:37.440327 run osmo-stp_10.42.42.5(pid=3613): stdout: | (launched: 2022-12-09_00:52:36.012596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:37.579596 run osmo-stp_10.42.42.5(pid=3613): stderr: | 20221209005236210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005236211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005236211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005236211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005236212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005236212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005236212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:37.716527 run osmo-stp_10.42.42.5(pid=3613): stdout: | (launched: 2022-12-09_00:52:36.012596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:37.846758 run osmo-stp_10.42.42.5(pid=3613): stderr: | 20221209005236210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005236211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005236211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005236211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005236212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005236212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005236212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:38.002488 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3613): Process ended prematurely: osmo-stp_10.42.42.5(pid=3613) [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3613)] [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 00:52:38.012005 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 00:52:38.040155 run osmo-hlr_10.42.42.2(pid=3607): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3607)] 00:52:38.090835 run osmo-hlr_10.42.42.2(pid=3607): stdout: | (launched: 2022-12-09_00:52:34.990818) 00:52:38.143546 run osmo-hlr_10.42.42.2(pid=3607): stderr: | 20221209005235191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005235191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005235191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005235191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005235191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005235191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005235204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005235213 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005235213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005235213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:38.216714 run osmo-msc_10.42.42.6(pid=3616): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3616)] 00:52:38.267514 run osmo-msc_10.42.42.6(pid=3616): stdout: | (launched: 2022-12-09_00:52:37.059321) 00:52:38.319683 run osmo-msc_10.42.42.6(pid=3616): stderr: | 20221209005237383 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005237383 DLGLOBAL DEBUG validating counter group 0x7f26e6079c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005237383 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005237383 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005237383 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005237383 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005237387 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005237387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005237387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005237387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:38.372338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3606): Terminating (SIGTERM) 00:52:38.414319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3610): Terminating (SIGTERM) 00:52:38.456281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3615): Terminating (SIGTERM) 00:52:38.498743 --- ParallelTerminationStrategy: PID 3606 died... 00:52:38.519407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3606): Terminated: ok {rc=0} 00:52:38.566204 --- ParallelTerminationStrategy: PID 3610 died... 00:52:38.585877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3610): Terminated: ok {rc=0} 00:52:38.632316 --- ParallelTerminationStrategy: PID 3615 died... 00:52:38.652002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3615): Terminated: ok {rc=0} 00:52:38.740150 bus /sierra_3: Setting Powered False 00:52:39.839818 bus /sierra_3: Setting Powered False 00:52:40.956447 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:52:42.189582 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:52:42.195769 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:52:42.216305 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:52:42.242647 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:52:42.296262 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:52:42.316720 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:52:42.343469 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:52:42.889511 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:52:42.938530 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:42.949507 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:52:43.004697 tst mo_mt_call.py: using LAC 17930 00:52:43.129985 tst mo_mt_call.py: using RAC 80 00:52:43.246977 tst mo_mt_call.py: using CellId 17930 00:52:43.364597 tst mo_mt_call.py: using BVCI 17931 00:52:43.475095 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:43.486146 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:43.496756 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:43.507875 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:43.518976 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:43.530094 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:43.649207 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:43.768315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:44.278749 run create_hlr_db(pid=3621): Launched 00:52:44.412440 bus /sierra_2: Setting Powered False 00:52:45.477132 run create_hlr_db(pid=3621): Terminated: ok {rc=0} 00:52:45.934017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3623): Launched 00:52:46.293721 run osmo-hlr_10.42.42.2(pid=3624): Launched 00:52:46.539937 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:47.179689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3626): Launched 00:52:47.527676 run osmo-stp_10.42.42.5(pid=3627): Launched 00:52:47.653976 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:48.249265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3629): Launched 00:52:48.578974 run osmo-msc_10.42.42.6(pid=3630): Launched 00:52:48.763382 run osmo-stp_10.42.42.5(pid=3627): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3627)] 00:52:48.902160 run osmo-stp_10.42.42.5(pid=3627): stdout: | (launched: 2022-12-09_00:52:47.466037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:49.041105 run osmo-stp_10.42.42.5(pid=3627): stderr: | 20221209005247662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005247662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005247662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005247662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005247663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005247663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005247663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:49.178237 run osmo-stp_10.42.42.5(pid=3627): stdout: | (launched: 2022-12-09_00:52:47.466037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:49.308758 run osmo-stp_10.42.42.5(pid=3627): stderr: | 20221209005247662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005247662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005247662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005247662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005247663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005247663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005247663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:49.464927 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3627): Process ended prematurely: osmo-stp_10.42.42.5(pid=3627) [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3627)] [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:52:49.474470 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 00:52:49.502513 run osmo-hlr_10.42.42.2(pid=3624): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3624)] 00:52:49.553644 run osmo-hlr_10.42.42.2(pid=3624): stdout: | (launched: 2022-12-09_00:52:46.219630) 00:52:49.606140 run osmo-hlr_10.42.42.2(pid=3624): stderr: | 20221209005246427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005246427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005246428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005246428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005246428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005246428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005246443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005246459 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005246459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005246459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:49.679000 run osmo-msc_10.42.42.6(pid=3630): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3630)] 00:52:49.729673 run osmo-msc_10.42.42.6(pid=3630): stdout: | (launched: 2022-12-09_00:52:48.517923) 00:52:49.782046 run osmo-msc_10.42.42.6(pid=3630): stderr: | 20221209005248842 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005248842 DLGLOBAL DEBUG validating counter group 0x7f2bd41dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005248842 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005248842 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005248843 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005248843 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005248844 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005248845 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005248845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005248845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:49.834889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3623): Terminating (SIGTERM) 00:52:49.876936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3626): Terminating (SIGTERM) 00:52:49.919113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3629): Terminating (SIGTERM) 00:52:49.961601 --- ParallelTerminationStrategy: PID 3623 died... 00:52:49.981929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3623): Terminated: ok {rc=0} 00:52:50.028669 --- ParallelTerminationStrategy: PID 3626 died... 00:52:50.048523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3626): Terminated: ok {rc=0} 00:52:50.095180 --- ParallelTerminationStrategy: PID 3629 died... 00:52:50.114964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3629): Terminated: ok {rc=0} 00:52:50.203412 bus /sierra_3: Setting Powered False 00:52:51.304088 bus /sierra_3: Setting Powered False 00:52:52.423191 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:52:53.571671 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:53.583488 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:52:53.639748 tst mo_mt_call_osmux.py: using LAC 17931 00:52:53.761846 tst mo_mt_call_osmux.py: using RAC 81 00:52:53.881378 tst mo_mt_call_osmux.py: using CellId 17931 00:52:54.001110 tst mo_mt_call_osmux.py: using BVCI 17932 00:52:54.111914 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:54.123015 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:54.133776 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:54.144720 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:54.155839 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:54.166951 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:54.282460 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:54.401433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:54.911166 run create_hlr_db(pid=3632): Launched 00:52:55.044023 bus /sierra_2: Setting Powered False 00:52:56.109247 run create_hlr_db(pid=3632): Terminated: ok {rc=0} 00:52:56.546585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3634): Launched 00:52:56.852484 run osmo-hlr_10.42.42.2(pid=3635): Launched 00:52:56.968719 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:57.507769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3637): Launched 00:52:57.813662 run osmo-stp_10.42.42.5(pid=3638): Launched 00:52:57.930424 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:58.481738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3640): Launched 00:52:58.787359 run osmo-msc_10.42.42.6(pid=3641): Launched 00:52:58.959145 run osmo-stp_10.42.42.5(pid=3638): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3638)] 00:52:59.089297 run osmo-stp_10.42.42.5(pid=3638): stdout: | (launched: 2022-12-09_00:52:57.756652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:59.218949 run osmo-stp_10.42.42.5(pid=3638): stderr: | 20221209005257928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005257928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005257929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005257929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005257930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005257930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005257930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:59.346806 run osmo-stp_10.42.42.5(pid=3638): stdout: | (launched: 2022-12-09_00:52:57.756652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:59.468178 run osmo-stp_10.42.42.5(pid=3638): stderr: | 20221209005257928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005257928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005257929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005257929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005257930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005257930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005257930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:59.613739 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3638): Process ended prematurely: osmo-stp_10.42.42.5(pid=3638) [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3638)] [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:52:59.622347 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:52:59.649581 run osmo-hlr_10.42.42.2(pid=3635): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3635)] 00:52:59.697933 run osmo-hlr_10.42.42.2(pid=3635): stdout: | (launched: 2022-12-09_00:52:56.795965) 00:52:59.748250 run osmo-hlr_10.42.42.2(pid=3635): stderr: | 20221209005256973 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005256973 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005256973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005256973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005256973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005256973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005256985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005256994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005256994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005256994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:59.817955 run osmo-msc_10.42.42.6(pid=3641): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3641)] 00:52:59.866422 run osmo-msc_10.42.42.6(pid=3641): stdout: | (launched: 2022-12-09_00:52:58.730431) 00:52:59.916353 run osmo-msc_10.42.42.6(pid=3641): stderr: | 20221209005259001 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005259002 DLGLOBAL DEBUG validating counter group 0x7f9661ea9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005259002 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005259002 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005259002 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005259002 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005259005 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005259006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005259006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005259006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:59.966830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3634): Terminating (SIGTERM) 00:53:00.006916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3637): Terminating (SIGTERM) 00:53:00.047651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3640): Terminating (SIGTERM) 00:53:00.088633 --- ParallelTerminationStrategy: PID 3634 died... 00:53:00.107923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3634): Terminated: ok {rc=0} 00:53:00.152279 --- ParallelTerminationStrategy: PID 3637 died... 00:53:00.171381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3637): Terminated: ok {rc=0} 00:53:00.216021 --- ParallelTerminationStrategy: PID 3640 died... 00:53:00.234757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3640): Terminated: ok {rc=0} 00:53:00.320712 bus /sierra_3: Setting Powered False 00:53:01.441744 bus /sierra_3: Setting Powered False 00:53:02.613958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:53:03.884493 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:53:03.893907 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:53:03.917561 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:53:03.946627 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:53:03.999416 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:53:04.021657 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:53:04.051556 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:53:04.602590 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:53:04.659642 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:04.672574 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:53:04.730609 tst mo_mt_call.py: using LAC 17932 00:53:04.860527 tst mo_mt_call.py: using RAC 82 00:53:04.989490 tst mo_mt_call.py: using CellId 17932 00:53:05.114965 tst mo_mt_call.py: using BVCI 17933 00:53:05.227713 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:05.239757 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:05.251540 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:05.264282 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:05.277862 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:05.289680 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:53:05.408121 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:53:05.525496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:06.012368 run create_hlr_db(pid=3918): Launched 00:53:06.154342 bus /sierra_2: Setting Powered False 00:53:07.215791 run create_hlr_db(pid=3918): Terminated: ok {rc=0} 00:53:07.656186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3920): Launched 00:53:07.983998 run osmo-hlr_10.42.42.2(pid=3921): Launched 00:53:08.224417 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:08.964213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3923): Launched 00:53:09.295270 run osmo-stp_10.42.42.5(pid=3924): Launched 00:53:09.535576 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:10.269846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3926): Launched 00:53:10.603289 run osmo-msc_10.42.42.6(pid=3927): Launched 00:53:10.961980 run osmo-stp_10.42.42.5(pid=3924): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3924)] 00:53:11.238407 run osmo-stp_10.42.42.5(pid=3924): stdout: | (launched: 2022-12-09_00:53:09.236504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:11.517361 run osmo-stp_10.42.42.5(pid=3924): stderr: | 20221209005309568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005309568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005309568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005309568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005309577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005309577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005309577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:11.699594 run osmo-stp_10.42.42.5(pid=3924): stdout: | (launched: 2022-12-09_00:53:09.236504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:11.825227 run osmo-stp_10.42.42.5(pid=3924): stderr: | 20221209005309568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005309568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005309568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005309568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005309577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005309577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005309577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:11.977593 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3924): Process ended prematurely: osmo-stp_10.42.42.5(pid=3924) [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3924)] [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:53:11.987515 tst mo_mt_call.py:8: Test FAILED (7.4 sec) 00:53:12.018324 run osmo-hlr_10.42.42.2(pid=3921): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3921)] 00:53:12.071065 run osmo-hlr_10.42.42.2(pid=3921): stdout: | (launched: 2022-12-09_00:53:07.926084) 00:53:12.123746 run osmo-hlr_10.42.42.2(pid=3921): stderr: | 20221209005308271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005308271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005308271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005308271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005308272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005308272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005308291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005308303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005308303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005308303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:12.197227 run osmo-msc_10.42.42.6(pid=3927): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3927)] 00:53:12.249573 run osmo-msc_10.42.42.6(pid=3927): stdout: | (launched: 2022-12-09_00:53:10.541550) 00:53:12.302887 run osmo-msc_10.42.42.6(pid=3927): stderr: | 20221209005311146 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005311146 DLGLOBAL DEBUG validating counter group 0x7f9c240d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005311146 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005311146 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005311146 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005311147 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005311148 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005311157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005311157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005311157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:12.356333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3920): Terminating (SIGTERM) 00:53:12.399710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3923): Terminating (SIGTERM) 00:53:12.445352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3926): Terminating (SIGTERM) 00:53:12.491351 --- ParallelTerminationStrategy: PID 3920 died... 00:53:12.511882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3920): Terminated: ok {rc=0} 00:53:12.562372 --- ParallelTerminationStrategy: PID 3923 died... 00:53:12.582631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3923): Terminated: ok {rc=0} 00:53:12.631236 --- ParallelTerminationStrategy: PID 3926 died... 00:53:12.651438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3926): Terminated: ok {rc=0} 00:53:12.742655 bus /sierra_3: Setting Powered False 00:53:13.844911 bus /sierra_3: Setting Powered False 00:53:14.965122 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:53:16.173644 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:16.192212 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:53:16.264693 tst mo_mt_call_osmux.py: using LAC 17933 00:53:16.411718 tst mo_mt_call_osmux.py: using RAC 83 00:53:16.563476 tst mo_mt_call_osmux.py: using CellId 17933 00:53:16.688810 tst mo_mt_call_osmux.py: using BVCI 17934 00:53:16.828779 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:16.841793 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:16.856138 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:16.871983 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:16.887275 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:16.902403 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:53:17.047083 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:53:17.189447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:17.805306 run create_hlr_db(pid=3929): Launched 00:53:17.989942 bus /sierra_2: Setting Powered False 00:53:19.056108 run create_hlr_db(pid=3929): Terminated: ok {rc=0} 00:53:19.535088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3931): Launched 00:53:19.886903 run osmo-hlr_10.42.42.2(pid=3932): Launched 00:53:20.145850 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:20.831120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3934): Launched 00:53:21.182949 run osmo-stp_10.42.42.5(pid=3935): Launched 00:53:21.438419 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:22.136272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3937): Launched 00:53:22.491315 run osmo-msc_10.42.42.6(pid=3938): Launched 00:53:22.875156 run osmo-stp_10.42.42.5(pid=3935): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3935)] 00:53:23.165710 run osmo-stp_10.42.42.5(pid=3935): stdout: | (launched: 2022-12-09_00:53:21.121814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:23.333215 run osmo-stp_10.42.42.5(pid=3935): stderr: | 20221209005321419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005321419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005321419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005321420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005321420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005321420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005321420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:23.475824 run osmo-stp_10.42.42.5(pid=3935): stdout: | (launched: 2022-12-09_00:53:21.121814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:23.612557 run osmo-stp_10.42.42.5(pid=3935): stderr: | 20221209005321419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005321419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005321419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005321420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005321420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005321420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005321420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:23.776669 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3935): Process ended prematurely: osmo-stp_10.42.42.5(pid=3935) [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3935)] [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:53:23.787346 tst mo_mt_call_osmux.py:8: Test FAILED (7.7 sec) 00:53:23.817582 run osmo-hlr_10.42.42.2(pid=3932): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3932)] 00:53:23.878143 run osmo-hlr_10.42.42.2(pid=3932): stdout: | (launched: 2022-12-09_00:53:19.824622) 00:53:23.931702 run osmo-hlr_10.42.42.2(pid=3932): stderr: | 20221209005320139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005320139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005320139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005320139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005320140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005320140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005320159 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005320167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005320167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005320167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:24.005348 run osmo-msc_10.42.42.6(pid=3938): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3938)] 00:53:24.056556 run osmo-msc_10.42.42.6(pid=3938): stdout: | (launched: 2022-12-09_00:53:22.427911) 00:53:24.109300 run osmo-msc_10.42.42.6(pid=3938): stderr: | 20221209005322939 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005322939 DLGLOBAL DEBUG validating counter group 0x7fefec13cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005322939 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005322939 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005322939 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005322940 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005322948 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005322948 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005322948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005322957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:24.162292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3931): Terminating (SIGTERM) 00:53:24.204936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3934): Terminating (SIGTERM) 00:53:24.247538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3937): Terminating (SIGTERM) 00:53:24.290464 --- ParallelTerminationStrategy: PID 3931 died... 00:53:24.311267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3931): Terminated: ok {rc=0} 00:53:24.358803 --- ParallelTerminationStrategy: PID 3934 died... 00:53:24.378819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3934): Terminated: ok {rc=0} 00:53:24.425982 --- ParallelTerminationStrategy: PID 3937 died... 00:53:24.446122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3937): Terminated: ok {rc=0} 00:53:24.535634 bus /sierra_3: Setting Powered False 00:53:25.635777 bus /sierra_3: Setting Powered False 00:53:26.751299 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:53:28.003934 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:53:28.010950 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:53:28.032415 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 00:53:28.060058 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 00:53:28.120372 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:53:28.141723 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 00:53:28.168885 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 00:53:28.714261 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 00:53:28.767026 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:28.778465 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:53:28.836828 tst mo_mt_call.py: using LAC 17934 00:53:28.967481 tst mo_mt_call.py: using RAC 84 00:53:29.098400 tst mo_mt_call.py: using CellId 17934 00:53:29.229181 tst mo_mt_call.py: using BVCI 17935 00:53:29.349361 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:29.360672 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:29.372003 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:29.383109 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:29.394183 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:29.405265 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:53:29.523735 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:53:29.637493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:30.111960 run create_hlr_db(pid=3944): Launched 00:53:30.230056 bus /sierra_2: Setting Powered False 00:53:31.296613 run create_hlr_db(pid=3944): Terminated: ok {rc=0} 00:53:31.771047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3946): Launched 00:53:32.119953 run osmo-hlr_10.42.42.2(pid=3947): Launched 00:53:32.263011 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:32.788563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3949): Launched 00:53:33.095675 run osmo-stp_10.42.42.5(pid=3950): Launched 00:53:33.215417 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:33.770316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3952): Launched 00:53:34.078233 run osmo-msc_10.42.42.6(pid=3953): Launched 00:53:34.251722 run osmo-stp_10.42.42.5(pid=3950): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3950)] 00:53:34.381662 run osmo-stp_10.42.42.5(pid=3950): stdout: | (launched: 2022-12-09_00:53:33.039014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:34.510722 run osmo-stp_10.42.42.5(pid=3950): stderr: | 20221209005333209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005333209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005333209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005333210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005333212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005333212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005333212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:34.638523 run osmo-stp_10.42.42.5(pid=3950): stdout: | (launched: 2022-12-09_00:53:33.039014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:34.760472 run osmo-stp_10.42.42.5(pid=3950): stderr: | 20221209005333209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005333209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005333209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005333210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005333212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005333212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005333212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:34.906543 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3950): Process ended prematurely: osmo-stp_10.42.42.5(pid=3950) [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3950)] [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 00:53:34.915456 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:53:34.942189 run osmo-hlr_10.42.42.2(pid=3947): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3947)] 00:53:34.990998 run osmo-hlr_10.42.42.2(pid=3947): stdout: | (launched: 2022-12-09_00:53:32.058831) 00:53:35.041410 run osmo-hlr_10.42.42.2(pid=3947): stderr: | 20221209005332249 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005332249 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005332249 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005332249 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005332249 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005332249 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005332263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005332273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005332273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005332273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:35.111920 run osmo-msc_10.42.42.6(pid=3953): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3953)] 00:53:35.160283 run osmo-msc_10.42.42.6(pid=3953): stdout: | (launched: 2022-12-09_00:53:34.021372) 00:53:35.210310 run osmo-msc_10.42.42.6(pid=3953): stderr: | 20221209005334296 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005334296 DLGLOBAL DEBUG validating counter group 0x7f916d36ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005334296 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005334297 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005334297 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005334297 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005334299 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005334299 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005334299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005334299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:35.260655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3946): Terminating (SIGTERM) 00:53:35.300685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3949): Terminating (SIGTERM) 00:53:35.340764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3952): Terminating (SIGTERM) 00:53:35.381276 --- ParallelTerminationStrategy: PID 3946 died... 00:53:35.400660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3946): Terminated: ok {rc=0} 00:53:35.445913 --- ParallelTerminationStrategy: PID 3949 died... 00:53:35.464720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3949): Terminated: ok {rc=0} 00:53:35.509774 --- ParallelTerminationStrategy: PID 3952 died... 00:53:35.528550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3952): Terminated: ok {rc=0} 00:53:35.615775 bus /sierra_3: Setting Powered False 00:53:36.717187 bus /sierra_3: Setting Powered False 00:53:37.831909 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 00:53:38.981956 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:38.993962 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:53:39.057299 tst mo_mt_call_osmux.py: using LAC 17935 00:53:39.185039 tst mo_mt_call_osmux.py: using RAC 85 00:53:39.312064 tst mo_mt_call_osmux.py: using CellId 17935 00:53:39.439188 tst mo_mt_call_osmux.py: using BVCI 17936 00:53:39.558795 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:39.570212 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:39.581621 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:39.592749 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:39.603966 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:39.615214 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:53:39.732239 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:53:39.852794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:40.363250 run create_hlr_db(pid=3955): Launched 00:53:40.496379 bus /sierra_2: Setting Powered False 00:53:41.562505 run create_hlr_db(pid=3955): Terminated: ok {rc=0} 00:53:42.000657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3957): Launched 00:53:42.308200 run osmo-hlr_10.42.42.2(pid=3958): Launched 00:53:42.426327 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:42.968082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3960): Launched 00:53:43.275394 run osmo-stp_10.42.42.5(pid=3961): Launched 00:53:43.395151 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:43.953129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3963): Launched 00:53:44.260859 run osmo-msc_10.42.42.6(pid=3964): Launched 00:53:44.434065 run osmo-stp_10.42.42.5(pid=3961): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3961)] 00:53:44.564120 run osmo-stp_10.42.42.5(pid=3961): stdout: | (launched: 2022-12-09_00:53:43.218764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:44.694920 run osmo-stp_10.42.42.5(pid=3961): stderr: | 20221209005343390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005343390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005343390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005343391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005343391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005343391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005343391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:44.822226 run osmo-stp_10.42.42.5(pid=3961): stdout: | (launched: 2022-12-09_00:53:43.218764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:44.944030 run osmo-stp_10.42.42.5(pid=3961): stderr: | 20221209005343390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005343390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005343390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005343391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005343391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005343391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005343391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:45.089668 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3961): Process ended prematurely: osmo-stp_10.42.42.5(pid=3961) [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3961)] [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 00:53:45.098642 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:53:45.125945 run osmo-hlr_10.42.42.2(pid=3958): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3958)] 00:53:45.174445 run osmo-hlr_10.42.42.2(pid=3958): stdout: | (launched: 2022-12-09_00:53:42.251086) 00:53:45.224249 run osmo-hlr_10.42.42.2(pid=3958): stderr: | 20221209005342429 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005342429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005342429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005342429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005342429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005342429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005342442 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005342450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005342451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005342451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:45.293913 run osmo-msc_10.42.42.6(pid=3964): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3964)] 00:53:45.342086 run osmo-msc_10.42.42.6(pid=3964): stdout: | (launched: 2022-12-09_00:53:44.203820) 00:53:45.392103 run osmo-msc_10.42.42.6(pid=3964): stderr: | 20221209005344480 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005344480 DLGLOBAL DEBUG validating counter group 0x7f4798622c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005344480 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005344480 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005344480 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005344480 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005344482 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005344483 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005344483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005344483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:45.442298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3957): Terminating (SIGTERM) 00:53:45.482038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3960): Terminating (SIGTERM) 00:53:45.522120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3963): Terminating (SIGTERM) 00:53:45.562411 --- ParallelTerminationStrategy: PID 3957 died... 00:53:45.581474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3957): Terminated: ok {rc=0} 00:53:45.626197 --- ParallelTerminationStrategy: PID 3960 died... 00:53:45.644763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3960): Terminated: ok {rc=0} 00:53:45.689305 --- ParallelTerminationStrategy: PID 3963 died... 00:53:45.707994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3963): Terminated: ok {rc=0} 00:53:45.793521 bus /sierra_3: Setting Powered False 00:53:46.893055 bus /sierra_3: Setting Powered False 00:53:48.009779 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 emergency:oc2g --------------------------------------------------------------------- 00:53:49.244260 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:53:49.248717 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 00:53:49.269943 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 00:53:49.297172 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 00:53:49.383970 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 00:53:49.405060 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 00:53:49.432196 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 00:53:50.016743 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2352 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 00:53:50.021976 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:50.032935 tst emergency:oc2g: Using 1 x bts (candidates: 1) 00:53:50.069513 tst emergency_mo_mt_call.py: using LAC 17936 00:53:50.195703 tst emergency_mo_mt_call.py: using RAC 86 00:53:50.321358 tst emergency_mo_mt_call.py: using CellId 17936 00:53:50.452049 tst emergency_mo_mt_call.py: using BVCI 17937 00:53:50.562816 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:50.573531 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:50.584129 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:50.594934 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:50.605649 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:50.616270 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:50.734459 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:50.849732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:51.315323 run create_hlr_db(pid=3970): Launched 00:53:51.431134 bus /sierra_2: Setting Powered False 00:53:52.491176 run create_hlr_db(pid=3970): Terminated: ok {rc=0} 00:53:52.934524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3972): Launched 00:53:53.258968 run osmo-hlr_10.42.42.2(pid=3973): Launched 00:53:53.382489 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:53.939663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3975): Launched 00:53:54.264890 run osmo-stp_10.42.42.5(pid=3976): Launched 00:53:54.397501 tst emergency_mo_mt_call.py: using MSISDN 6944 00:53:54.565045 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:55.147366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3978): Launched 00:53:55.472232 run osmo-msc_10.42.42.6(pid=3979): Launched 00:53:55.655270 run osmo-stp_10.42.42.5(pid=3976): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3976)] 00:53:55.791439 run osmo-stp_10.42.42.5(pid=3976): stdout: | (launched: 2022-12-09_00:53:54.205265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:55.927723 run osmo-stp_10.42.42.5(pid=3976): stderr: | 20221209005354399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005354399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005354400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005354400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005354401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005354401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005354401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:56.062873 run osmo-stp_10.42.42.5(pid=3976): stdout: | (launched: 2022-12-09_00:53:54.205265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:56.191458 run osmo-stp_10.42.42.5(pid=3976): stderr: | 20221209005354399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005354399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005354400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005354400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005354401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005354401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005354401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:56.344665 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=3976): Process ended prematurely: osmo-stp_10.42.42.5(pid=3976) [trial-2352↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3976)] [trial-2352↪emergency:oc2g↪emergency_mo_mt_call.py:19] 00:53:56.353888 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 00:53:56.381593 run osmo-hlr_10.42.42.2(pid=3973): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3973)] 00:53:56.432188 run osmo-hlr_10.42.42.2(pid=3973): stdout: | (launched: 2022-12-09_00:53:53.198291) 00:53:56.484607 run osmo-hlr_10.42.42.2(pid=3973): stderr: | 20221209005353398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005353398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005353398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005353398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005353398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005353398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005353414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005353423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005353423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005353423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:56.558441 run osmo-msc_10.42.42.6(pid=3979): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3979)] 00:53:56.609057 run osmo-msc_10.42.42.6(pid=3979): stdout: | (launched: 2022-12-09_00:53:55.412215) 00:53:56.661262 run osmo-msc_10.42.42.6(pid=3979): stderr: | 20221209005355734 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005355734 DLGLOBAL DEBUG validating counter group 0x7f43c4413c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005355734 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005355735 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005355735 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005355735 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005355737 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005355737 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005355737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005355737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:56.713674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3972): Terminating (SIGTERM) 00:53:56.755852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3975): Terminating (SIGTERM) 00:53:56.798092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3978): Terminating (SIGTERM) 00:53:56.840652 --- ParallelTerminationStrategy: PID 3972 died... 00:53:56.861093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3972): Terminated: ok {rc=0} 00:53:56.908029 --- ParallelTerminationStrategy: PID 3975 died... 00:53:56.927940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3975): Terminated: ok {rc=0} 00:53:56.974404 --- ParallelTerminationStrategy: PID 3978 died... 00:53:56.994413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3978): Terminated: ok {rc=0} 00:53:57.083139 bus /sierra_3: Setting Powered False 00:53:58.182919 bus /sierra_3: Setting Powered False 00:53:59.298573 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 00:54:00.385299 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:54:00.397238 tst emergency:oc2g: Using 1 x bts (candidates: 1) 00:54:00.436276 tst emergency_preemptive_call.py: using LAC 17937 00:54:00.565218 tst emergency_preemptive_call.py: using RAC 87 00:54:00.691609 tst emergency_preemptive_call.py: using CellId 17937 00:54:00.821405 tst emergency_preemptive_call.py: using BVCI 17938 00:54:00.955899 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:54:00.967668 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:54:00.979151 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:54:00.991640 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:54:01.004120 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:54:01.016503 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:54:01.136887 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:54:01.253875 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:54:01.375821 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:54:01.495398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:02.086960 run create_hlr_db(pid=3981): Launched 00:54:02.275793 bus /sierra_2: Setting Powered False 00:54:03.335945 run create_hlr_db(pid=3981): Terminated: ok {rc=0} 00:54:03.785707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3983): Launched 00:54:04.111882 run osmo-hlr_10.42.42.2(pid=3984): Launched 00:54:04.236098 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:04.795726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3986): Launched 00:54:05.122507 run osmo-stp_10.42.42.5(pid=3989): Launched 00:54:05.255897 tst emergency_preemptive_call.py: using MSISDN 6945 00:54:05.421270 run osmo-msc_10.42.42.6: Starting osmo-msc 00:54:06.000678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3991): Launched 00:54:06.324632 run osmo-msc_10.42.42.6(pid=3992): Launched 00:54:06.504676 run osmo-stp_10.42.42.5(pid=3989): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3989)] 00:54:06.640589 run osmo-stp_10.42.42.5(pid=3989): stdout: | (launched: 2022-12-09_00:54:05.062093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:06.776334 run osmo-stp_10.42.42.5(pid=3989): stderr: | 20221209005405254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005405254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005405254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005405255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005405255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005405255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005405255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:06.911985 run osmo-stp_10.42.42.5(pid=3989): stdout: | (launched: 2022-12-09_00:54:05.062093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:07.040288 run osmo-stp_10.42.42.5(pid=3989): stderr: | 20221209005405254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005405254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005405254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005405255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005405255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005405255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005405255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:07.193648 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=3989): Process ended prematurely: osmo-stp_10.42.42.5(pid=3989) [trial-2352↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3989)] [trial-2352↪emergency:oc2g↪emergency_preemptive_call.py:32] 00:54:07.202653 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 00:54:07.230435 run osmo-hlr_10.42.42.2(pid=3984): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3984)] 00:54:07.281166 run osmo-hlr_10.42.42.2(pid=3984): stdout: | (launched: 2022-12-09_00:54:04.051958) 00:54:07.333500 run osmo-hlr_10.42.42.2(pid=3984): stderr: | 20221209005404253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005404253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005404253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005404253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005404253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005404253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005404266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005404274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005404274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005404274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:07.406879 run osmo-msc_10.42.42.6(pid=3992): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3992)] 00:54:07.457568 run osmo-msc_10.42.42.6(pid=3992): stdout: | (launched: 2022-12-09_00:54:06.264906) 00:54:07.509906 run osmo-msc_10.42.42.6(pid=3992): stderr: | 20221209005406587 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005406587 DLGLOBAL DEBUG validating counter group 0x7fbb2eadac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005406587 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005406587 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005406588 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005406588 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005406590 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005406591 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005406591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005406591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:54:07.562972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3983): Terminating (SIGTERM) 00:54:07.605292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3986): Terminating (SIGTERM) 00:54:07.647392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3991): Terminating (SIGTERM) 00:54:07.689475 --- ParallelTerminationStrategy: PID 3983 died... 00:54:07.709567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3983): Terminated: ok {rc=0} 00:54:07.756062 --- ParallelTerminationStrategy: PID 3986 died... 00:54:07.775869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3986): Terminated: ok {rc=0} 00:54:07.822575 --- ParallelTerminationStrategy: PID 3991 died... 00:54:07.842464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3991): Terminated: ok {rc=0} 00:54:07.931211 bus /sierra_9: Setting Powered False 00:54:09.032345 bus /sierra_9: Setting Powered False 00:54:10.150020 bus /sierra_8: Setting Powered False 00:54:11.250162 bus /sierra_8: Setting Powered False 00:54:12.370080 bus /sierra_3: Setting Powered False 00:54:13.469225 bus /sierra_3: Setting Powered False 00:54:14.584897 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:oc2g --------------------------------------------------------------------- 00:54:15.856423 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:54:15.866675 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 00:54:15.904433 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 00:54:15.945356 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 00:54:16.037497 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 00:54:16.065061 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 00:54:16.113704 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 00:54:16.687001 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 00:54:16.756080 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:16.770925 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:16.814510 tst cs_paging_gprs_active.py: using LAC 17938 00:54:16.945077 tst cs_paging_gprs_active.py: using RAC 88 00:54:17.070616 tst cs_paging_gprs_active.py: using CellId 17938 00:54:17.220312 tst cs_paging_gprs_active.py: using BVCI 17939 00:54:17.336479 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.347173 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.357820 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.368666 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.379388 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.390134 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.401045 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.411585 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.422406 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:17.542904 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:17.659844 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:54:17.865785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:18.174090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3997): Launched 00:54:18.444044 run iperf3-srv_10.42.42.10(pid=3998): Launched 00:54:18.559654 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:54:18.764638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:19.073075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3999): Launched 00:54:19.341615 run iperf3-srv_10.42.42.10(pid=4000): Launched 00:54:19.457518 tst cs_paging_gprs_active.py:38: start network... 00:54:19.663464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:20.139059 run create_hlr_db(pid=4001): Launched 00:54:20.258571 bus /sierra_2: Setting Powered False 00:54:21.319465 run create_hlr_db(pid=4001): Terminated: ok {rc=0} 00:54:21.745549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4003): Launched 00:54:22.053686 run osmo-hlr_10.42.42.2(pid=4004): Launched 00:54:22.170972 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:22.714366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4006): Launched 00:54:23.021045 run osmo-stp_10.42.42.5(pid=4007): Launched 00:54:23.138509 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:23.665222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4009): Launched 00:54:23.782369 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:24.040937 run patchelf(pid=4010): Launched 00:54:24.212623 run osmo-stp_10.42.42.5(pid=4007): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4007)] 00:54:24.342879 run osmo-stp_10.42.42.5(pid=4007): stdout: | (launched: 2022-12-09_00:54:22.963943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:24.475207 run osmo-stp_10.42.42.5(pid=4007): stderr: | 20221209005423139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005423139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005423139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005423140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005423140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005423140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005423140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:24.607301 run osmo-stp_10.42.42.5(pid=4007): stdout: | (launched: 2022-12-09_00:54:22.963943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:24.732675 run osmo-stp_10.42.42.5(pid=4007): stderr: | 20221209005423139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005423139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005423139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005423140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005423140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005423140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005423140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:24.881632 run patchelf(pid=4010): Terminating (SIGINT) 00:54:25.055158 run patchelf(pid=4010): Terminated: ok {rc=0} 00:54:25.180316 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4007): Process ended prematurely: osmo-stp_10.42.42.5(pid=4007) [trial-2352↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4007)] [trial-2352↪gprs:oc2g↪cs_paging_gprs_active.py:38] 00:54:25.189861 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 00:54:25.217975 run osmo-hlr_10.42.42.2(pid=4004): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4004)] 00:54:25.266466 run osmo-hlr_10.42.42.2(pid=4004): stdout: | (launched: 2022-12-09_00:54:21.996372) 00:54:25.316288 run osmo-hlr_10.42.42.2(pid=4004): stderr: | 20221209005422176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005422176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005422176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005422176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005422176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005422176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005422187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005422196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005422196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005422196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:25.366938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3997): Terminating (SIGTERM) 00:54:25.407193 run iperf3-srv_10.42.42.10(pid=3998): Terminating (SIGTERM) 00:54:25.447478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3999): Terminating (SIGTERM) 00:54:25.487842 run iperf3-srv_10.42.42.10(pid=4000): Terminating (SIGTERM) 00:54:25.528056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4003): Terminating (SIGTERM) 00:54:25.568528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4006): Terminating (SIGTERM) 00:54:25.608904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4009): Terminating (SIGTERM) 00:54:25.649591 --- ParallelTerminationStrategy: PID 3997 died... 00:54:25.669081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3997): Terminated: ok {rc=0} 00:54:25.714338 --- ParallelTerminationStrategy: PID 3998 died... 00:54:25.733113 run iperf3-srv_10.42.42.10(pid=3998): Terminated {rc=256} 00:54:25.777641 --- ParallelTerminationStrategy: PID 3999 died... 00:54:25.796378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3999): Terminated: ok {rc=0} 00:54:25.841226 --- ParallelTerminationStrategy: PID 4000 died... 00:54:25.859845 run iperf3-srv_10.42.42.10(pid=4000): Terminated {rc=256} 00:54:25.904376 --- ParallelTerminationStrategy: PID 4003 died... 00:54:25.923141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4003): Terminated: ok {rc=0} 00:54:25.967369 --- ParallelTerminationStrategy: PID 4006 died... 00:54:25.986193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4006): Terminated: ok {rc=0} 00:54:26.031426 --- ParallelTerminationStrategy: PID 4009 died... 00:54:26.050458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4009): Terminated: ok {rc=0} 00:54:26.137458 bus /gobi_0: Setting Powered False 00:54:27.237562 bus /gobi_0: Setting Powered False 00:54:28.355064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g iperf3.py ---------------------------------------------- 00:54:29.506903 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:29.518471 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:29.555199 tst iperf3.py: using LAC 17939 00:54:29.686495 tst iperf3.py: using RAC 89 00:54:29.817225 tst iperf3.py: using CellId 17939 00:54:29.946157 tst iperf3.py: using BVCI 17940 00:54:30.066765 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:30.077823 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:30.088648 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:30.099688 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:30.110525 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:30.121351 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:30.132203 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:30.143199 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:30.154200 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:30.273144 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:54:30.478668 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:30.785760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4011): Launched 00:54:31.064443 run iperf3-srv_10.42.42.10(pid=4012): Launched 00:54:31.203868 tst iperf3.py:8: start network... 00:54:31.433781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:31.956994 run create_hlr_db(pid=4013): Launched 00:54:32.124045 bus /gobi_6: Setting Powered False 00:54:33.188646 run create_hlr_db(pid=4013): Terminated: ok {rc=0} 00:54:33.626812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4015): Launched 00:54:33.933322 run osmo-hlr_10.42.42.2(pid=4016): Launched 00:54:34.050516 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:34.592229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4018): Launched 00:54:34.899470 run osmo-stp_10.42.42.5(pid=4019): Launched 00:54:35.018306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:35.547967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4021): Launched 00:54:35.666550 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:35.925786 run patchelf(pid=4022): Launched 00:54:36.098250 run osmo-stp_10.42.42.5(pid=4019): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4019)] 00:54:36.229073 run osmo-stp_10.42.42.5(pid=4019): stdout: | (launched: 2022-12-09_00:54:34.842427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:36.360576 run osmo-stp_10.42.42.5(pid=4019): stderr: | 20221209005435012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005435013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005435013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005435013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005435015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005435016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005435016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:36.491949 run osmo-stp_10.42.42.5(pid=4019): stdout: | (launched: 2022-12-09_00:54:34.842427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:36.618193 run osmo-stp_10.42.42.5(pid=4019): stderr: | 20221209005435012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005435013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005435013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005435013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005435015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005435016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005435016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:36.766816 run patchelf(pid=4022): Terminating (SIGINT) 00:54:36.939741 run patchelf(pid=4022): Terminated: ok {rc=0} 00:54:37.064393 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4019): Process ended prematurely: osmo-stp_10.42.42.5(pid=4019) [trial-2352↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4019)] [trial-2352↪gprs:oc2g↪iperf3.py:8] 00:54:37.074353 tst iperf3.py:8: Test FAILED (7.6 sec) 00:54:37.102515 run osmo-hlr_10.42.42.2(pid=4016): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4016)] 00:54:37.151000 run osmo-hlr_10.42.42.2(pid=4016): stdout: | (launched: 2022-12-09_00:54:33.876193) 00:54:37.201253 run osmo-hlr_10.42.42.2(pid=4016): stderr: | 20221209005434056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005434056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005434057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005434057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005434057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005434057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005434069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005434077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005434078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005434078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:37.251854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4011): Terminating (SIGTERM) 00:54:37.292543 run iperf3-srv_10.42.42.10(pid=4012): Terminating (SIGTERM) 00:54:37.332941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4015): Terminating (SIGTERM) 00:54:37.373657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4018): Terminating (SIGTERM) 00:54:37.413792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4021): Terminating (SIGTERM) 00:54:37.454954 --- ParallelTerminationStrategy: PID 4011 died... 00:54:37.474539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4011): Terminated: ok {rc=0} 00:54:37.520863 --- ParallelTerminationStrategy: PID 4012 died... 00:54:37.540196 run iperf3-srv_10.42.42.10(pid=4012): Terminated {rc=256} 00:54:37.585191 --- ParallelTerminationStrategy: PID 4015 died... 00:54:37.604284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4015): Terminated: ok {rc=0} 00:54:37.649705 --- ParallelTerminationStrategy: PID 4018 died... 00:54:37.668669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4018): Terminated: ok {rc=0} 00:54:37.713474 --- ParallelTerminationStrategy: PID 4021 died... 00:54:37.732151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4021): Terminated: ok {rc=0} 00:54:37.817496 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g iperf3m4.py ---------------------------------------------- 00:54:38.965919 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:38.977088 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:39.013612 tst iperf3m4.py: using LAC 17940 00:54:39.135066 tst iperf3m4.py: using RAC 90 00:54:39.266778 tst iperf3m4.py: using CellId 17940 00:54:39.397485 tst iperf3m4.py: using BVCI 17941 00:54:39.517785 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:39.529066 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:39.540386 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:39.551523 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:39.562873 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:39.574056 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:39.585137 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:39.596093 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:39.607293 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:39.724571 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:39.847414 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:39.964289 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:40.084847 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:54:40.307021 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:40.639502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4023): Launched 00:54:40.929763 run iperf3-srv_10.42.42.10(pid=4024): Launched 00:54:41.055531 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:54:41.279493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:41.612516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4025): Launched 00:54:41.902288 run iperf3-srv_10.42.42.10(pid=4026): Launched 00:54:42.025995 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:54:42.248160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:42.579901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4027): Launched 00:54:42.869553 run iperf3-srv_10.42.42.10(pid=4028): Launched 00:54:42.993411 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:54:43.216423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:43.547872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4029): Launched 00:54:43.837389 run iperf3-srv_10.42.42.10(pid=4030): Launched 00:54:43.961215 tst iperf3m4.py:8: start network... 00:54:44.184132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:44.697517 run create_hlr_db(pid=4031): Launched 00:54:44.831747 bus /gobi_6: Setting Powered False 00:54:45.898825 run create_hlr_db(pid=4031): Terminated: ok {rc=0} 00:54:46.342526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4033): Launched 00:54:46.677688 run osmo-hlr_10.42.42.2(pid=4034): Launched 00:54:46.831789 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:47.556755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4036): Launched 00:54:47.890173 run osmo-stp_10.42.42.5(pid=4037): Launched 00:54:48.015528 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:48.585491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4039): Launched 00:54:48.713584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:48.993120 run patchelf(pid=4040): Launched 00:54:49.177397 run osmo-stp_10.42.42.5(pid=4037): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4037)] 00:54:49.317852 run osmo-stp_10.42.42.5(pid=4037): stdout: | (launched: 2022-12-09_00:54:47.828495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:49.458993 run osmo-stp_10.42.42.5(pid=4037): stderr: | 20221209005448023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005448023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005448023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005448023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005448024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005448024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005448024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:49.600747 run osmo-stp_10.42.42.5(pid=4037): stdout: | (launched: 2022-12-09_00:54:47.828495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:49.735923 run osmo-stp_10.42.42.5(pid=4037): stderr: | 20221209005448023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005448023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005448023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005448023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005448024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005448024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005448024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:49.895919 run patchelf(pid=4040): Terminating (SIGINT) 00:54:50.081700 run patchelf(pid=4040): Terminated: ok {rc=0} 00:54:50.215112 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4037): Process ended prematurely: osmo-stp_10.42.42.5(pid=4037) [trial-2352↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4037)] [trial-2352↪gprs:oc2g↪iperf3m4.py:8] 00:54:50.225395 tst iperf3m4.py:8: Test FAILED (11.3 sec) 00:54:50.254639 run osmo-hlr_10.42.42.2(pid=4034): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4034)] 00:54:50.305138 run osmo-hlr_10.42.42.2(pid=4034): stdout: | (launched: 2022-12-09_00:54:46.616604) 00:54:50.357638 run osmo-hlr_10.42.42.2(pid=4034): stderr: | 20221209005446970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005446970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005446970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005446970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005446970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005446970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005446990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005447003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005447003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005447003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:50.410353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4023): Terminating (SIGTERM) 00:54:50.452493 run iperf3-srv_10.42.42.10(pid=4024): Terminating (SIGTERM) 00:54:50.494464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4025): Terminating (SIGTERM) 00:54:50.536679 run iperf3-srv_10.42.42.10(pid=4026): Terminating (SIGTERM) 00:54:50.579777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4027): Terminating (SIGTERM) 00:54:50.622485 run iperf3-srv_10.42.42.10(pid=4028): Terminating (SIGTERM) 00:54:50.664678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4029): Terminating (SIGTERM) 00:54:50.707161 run iperf3-srv_10.42.42.10(pid=4030): Terminating (SIGTERM) 00:54:50.749431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4033): Terminating (SIGTERM) 00:54:50.791756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4036): Terminating (SIGTERM) 00:54:50.834161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4039): Terminating (SIGTERM) 00:54:50.876780 --- ParallelTerminationStrategy: PID 4023 died... 00:54:50.897256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4023): Terminated: ok {rc=0} 00:54:50.944178 --- ParallelTerminationStrategy: PID 4024 died... 00:54:50.964027 run iperf3-srv_10.42.42.10(pid=4024): Terminated {rc=256} 00:54:51.010570 --- ParallelTerminationStrategy: PID 4025 died... 00:54:51.030520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4025): Terminated: ok {rc=0} 00:54:51.077071 --- ParallelTerminationStrategy: PID 4026 died... 00:54:51.096996 run iperf3-srv_10.42.42.10(pid=4026): Terminated {rc=256} 00:54:51.143395 --- ParallelTerminationStrategy: PID 4027 died... 00:54:51.163159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4027): Terminated: ok {rc=0} 00:54:51.210336 --- ParallelTerminationStrategy: PID 4028 died... 00:54:51.230319 run iperf3-srv_10.42.42.10(pid=4028): Terminated {rc=256} 00:54:51.277086 --- ParallelTerminationStrategy: PID 4029 died... 00:54:51.296887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4029): Terminated: ok {rc=0} 00:54:51.343735 --- ParallelTerminationStrategy: PID 4030 died... 00:54:51.363596 run iperf3-srv_10.42.42.10(pid=4030): Terminated {rc=256} 00:54:51.410321 --- ParallelTerminationStrategy: PID 4033 died... 00:54:51.430354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4033): Terminated: ok {rc=0} 00:54:51.477128 --- ParallelTerminationStrategy: PID 4036 died... 00:54:51.497118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4036): Terminated: ok {rc=0} 00:54:51.543714 --- ParallelTerminationStrategy: PID 4039 died... 00:54:51.563621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4039): Terminated: ok {rc=0} 00:54:51.653277 bus /gobi_4: Setting Powered False 00:54:52.753091 bus /gobi_4: Setting Powered False 00:54:53.868812 bus /gobi_1: Setting Powered False 00:54:54.968228 bus /gobi_1: Setting Powered False 00:54:56.084359 bus /gobi_0: Setting Powered False 00:54:57.183296 bus /gobi_0: Setting Powered False 00:54:58.301643 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g ping.py ---------------------------------------------- 00:54:59.401678 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:59.412721 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:59.448403 tst ping.py: using LAC 17941 00:54:59.567180 tst ping.py: using RAC 91 00:54:59.687122 tst ping.py: using CellId 17941 00:54:59.807500 tst ping.py: using BVCI 17942 00:54:59.925577 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:59.936632 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:59.947538 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:59.958461 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:59.969235 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:59.980013 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:59.991023 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:55:00.001887 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:55:00.115334 tst ping.py:19: start network... 00:55:00.318112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:00.782739 run create_hlr_db(pid=4041): Launched 00:55:00.942674 bus /gobi_6: Setting Powered False 00:55:02.001886 run create_hlr_db(pid=4041): Terminated: ok {rc=0} 00:55:02.458509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4046): Launched 00:55:02.784543 run osmo-hlr_10.42.42.2(pid=4047): Launched 00:55:02.909572 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:03.474311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4049): Launched 00:55:03.800939 run osmo-stp_10.42.42.5(pid=4050): Launched 00:55:03.926708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:04.487118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4052): Launched 00:55:04.611962 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:04.887190 run patchelf(pid=4053): Launched 00:55:05.069287 run osmo-stp_10.42.42.5(pid=4050): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4050)] 00:55:05.206933 run osmo-stp_10.42.42.5(pid=4050): stdout: | (launched: 2022-12-09_00:55:03.740498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:05.347460 run osmo-stp_10.42.42.5(pid=4050): stderr: | 20221209005503934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005503935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005503935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005503935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005503938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005503938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005503938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:05.486615 run osmo-stp_10.42.42.5(pid=4050): stdout: | (launched: 2022-12-09_00:55:03.740498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:05.620101 run osmo-stp_10.42.42.5(pid=4050): stderr: | 20221209005503934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005503935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005503935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005503935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005503938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005503938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005503938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:05.777566 run patchelf(pid=4053): Terminating (SIGINT) 00:55:05.959013 run patchelf(pid=4053): Terminated: ok {rc=0} 00:55:06.089880 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4050): Process ended prematurely: osmo-stp_10.42.42.5(pid=4050) [trial-2352↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4050)] [trial-2352↪gprs:oc2g↪ping.py:22] 00:55:06.099676 tst ping.py:22: Test FAILED (6.7 sec) 00:55:06.128420 run osmo-hlr_10.42.42.2(pid=4047): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4047)] 00:55:06.179364 run osmo-hlr_10.42.42.2(pid=4047): stdout: | (launched: 2022-12-09_00:55:02.724260) 00:55:06.231954 run osmo-hlr_10.42.42.2(pid=4047): stderr: | 20221209005502923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005502923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005502923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005502923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005502923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005502923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005502936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005502944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005502944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005502944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:06.284828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4046): Terminating (SIGTERM) 00:55:06.327448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4049): Terminating (SIGTERM) 00:55:06.369861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4052): Terminating (SIGTERM) 00:55:06.412671 --- ParallelTerminationStrategy: PID 4046 died... 00:55:06.433208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4046): Terminated: ok {rc=0} 00:55:06.480138 --- ParallelTerminationStrategy: PID 4049 died... 00:55:06.500253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4049): Terminated: ok {rc=0} 00:55:06.547116 --- ParallelTerminationStrategy: PID 4052 died... 00:55:06.567187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4052): Terminated: ok {rc=0} 00:55:06.656660 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 00:55:07.745283 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:55:07.757147 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:55:07.795010 tst ping_idle_ping.py: using LAC 17942 00:55:07.923506 tst ping_idle_ping.py: using RAC 92 00:55:08.051323 tst ping_idle_ping.py: using CellId 17942 00:55:08.177610 tst ping_idle_ping.py: using BVCI 17943 00:55:08.290288 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:55:08.300846 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:55:08.311468 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:55:08.322631 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:55:08.333413 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:55:08.343849 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:55:08.354541 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:55:08.365438 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:55:08.481943 tst ping_idle_ping.py:24: start network... 00:55:08.701994 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:09.207003 run create_hlr_db(pid=4054): Launched 00:55:09.339577 bus /gobi_6: Setting Powered False 00:55:10.404165 run create_hlr_db(pid=4054): Terminated: ok {rc=0} 00:55:10.837671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4056): Launched 00:55:11.143055 run osmo-hlr_10.42.42.2(pid=4057): Launched 00:55:11.260269 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:11.782188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4059): Launched 00:55:12.087062 run osmo-stp_10.42.42.5(pid=4060): Launched 00:55:12.202179 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:12.725954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4062): Launched 00:55:12.843725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:13.099279 run patchelf(pid=4063): Launched 00:55:13.268634 run osmo-stp_10.42.42.5(pid=4060): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4060)] 00:55:13.398237 run osmo-stp_10.42.42.5(pid=4060): stdout: | (launched: 2022-12-09_00:55:12.030771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:13.528529 run osmo-stp_10.42.42.5(pid=4060): stderr: | 20221209005512201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005512201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005512201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005512202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005512202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005512202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005512202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:13.658750 run osmo-stp_10.42.42.5(pid=4060): stdout: | (launched: 2022-12-09_00:55:12.030771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:13.782962 run osmo-stp_10.42.42.5(pid=4060): stderr: | 20221209005512201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005512201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005512201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005512202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005512202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005512202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005512202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:13.930211 run patchelf(pid=4063): Terminating (SIGINT) 00:55:14.100860 run patchelf(pid=4063): Terminated: ok {rc=0} 00:55:14.223932 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4060): Process ended prematurely: osmo-stp_10.42.42.5(pid=4060) [trial-2352↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4060)] [trial-2352↪gprs:oc2g↪ping_idle_ping.py:27] 00:55:14.232932 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 00:55:14.260441 run osmo-hlr_10.42.42.2(pid=4057): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4057)] 00:55:14.309374 run osmo-hlr_10.42.42.2(pid=4057): stdout: | (launched: 2022-12-09_00:55:11.086130) 00:55:14.359568 run osmo-hlr_10.42.42.2(pid=4057): stderr: | 20221209005511262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005511262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005511262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005511262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005511262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005511262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005511274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005511282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005511283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005511283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:14.410224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4056): Terminating (SIGTERM) 00:55:14.450992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4059): Terminating (SIGTERM) 00:55:14.491694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4062): Terminating (SIGTERM) 00:55:14.532449 --- ParallelTerminationStrategy: PID 4056 died... 00:55:14.551815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4056): Terminated: ok {rc=0} 00:55:14.597612 --- ParallelTerminationStrategy: PID 4059 died... 00:55:14.616355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4059): Terminated: ok {rc=0} 00:55:14.662293 --- ParallelTerminationStrategy: PID 4062 died... 00:55:14.681270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4062): Terminated: ok {rc=0} 00:55:14.765581 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 00:55:16.112036 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:55:16.118614 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:55:16.143173 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:55:16.185313 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:55:16.276850 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:55:16.301490 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:55:16.342725 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:55:16.979005 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:55:17.033813 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:17.045246 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:17.083063 tst cs_paging_gprs_active.py: using LAC 17943 00:55:17.239942 tst cs_paging_gprs_active.py: using RAC 93 00:55:17.371376 tst cs_paging_gprs_active.py: using CellId 17943 00:55:17.500793 tst cs_paging_gprs_active.py: using BVCI 17944 00:55:17.619539 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:17.630942 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:17.642070 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:17.653756 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:17.665402 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:17.676800 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:17.688353 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:17.699691 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:17.711167 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:17.831077 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:17.947548 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:55:18.167411 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:18.493743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4067): Launched 00:55:18.776336 run iperf3-srv_10.42.42.10(pid=4068): Launched 00:55:18.897873 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:55:19.115993 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:19.445807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4069): Launched 00:55:19.729753 run iperf3-srv_10.42.42.10(pid=4070): Launched 00:55:19.852858 tst cs_paging_gprs_active.py:38: start network... 00:55:20.070750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:20.575967 run create_hlr_db(pid=4071): Launched 00:55:20.708385 bus /gobi_6: Setting Powered False 00:55:21.772880 run create_hlr_db(pid=4071): Terminated: ok {rc=0} 00:55:22.226353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4073): Launched 00:55:22.553125 run osmo-hlr_10.42.42.2(pid=4074): Launched 00:55:22.678001 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:23.241936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4076): Launched 00:55:23.568709 run osmo-stp_10.42.42.5(pid=4077): Launched 00:55:23.693009 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:24.253133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4079): Launched 00:55:24.379489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:24.654627 run patchelf(pid=4080): Launched 00:55:24.836078 run osmo-stp_10.42.42.5(pid=4077): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4077)] 00:55:24.973822 run osmo-stp_10.42.42.5(pid=4077): stdout: | (launched: 2022-12-09_00:55:23.508535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:25.113552 run osmo-stp_10.42.42.5(pid=4077): stderr: | 20221209005523701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005523701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005523701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005523702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005523704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005523704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005523704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:25.253811 run osmo-stp_10.42.42.5(pid=4077): stdout: | (launched: 2022-12-09_00:55:23.508535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:25.387373 run osmo-stp_10.42.42.5(pid=4077): stderr: | 20221209005523701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005523701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005523701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005523702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005523704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005523704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005523704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:25.545879 run patchelf(pid=4080): Terminating (SIGINT) 00:55:25.728458 run patchelf(pid=4080): Terminated: ok {rc=0} 00:55:25.860880 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4077): Process ended prematurely: osmo-stp_10.42.42.5(pid=4077) [trial-2352↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4077)] [trial-2352↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:55:25.871271 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 00:55:25.899918 run osmo-hlr_10.42.42.2(pid=4074): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4074)] 00:55:25.950279 run osmo-hlr_10.42.42.2(pid=4074): stdout: | (launched: 2022-12-09_00:55:22.492594) 00:55:26.002499 run osmo-hlr_10.42.42.2(pid=4074): stderr: | 20221209005522693 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005522693 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005522693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005522693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005522693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005522694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005522706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005522714 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005522714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005522714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:26.055202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4067): Terminating (SIGTERM) 00:55:26.097594 run iperf3-srv_10.42.42.10(pid=4068): Terminating (SIGTERM) 00:55:26.139820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4069): Terminating (SIGTERM) 00:55:26.182218 run iperf3-srv_10.42.42.10(pid=4070): Terminating (SIGTERM) 00:55:26.224320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4073): Terminating (SIGTERM) 00:55:26.266725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4076): Terminating (SIGTERM) 00:55:26.308914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4079): Terminating (SIGTERM) 00:55:26.351513 --- ParallelTerminationStrategy: PID 4067 died... 00:55:26.371684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4067): Terminated: ok {rc=0} 00:55:26.418357 --- ParallelTerminationStrategy: PID 4068 died... 00:55:26.437876 run iperf3-srv_10.42.42.10(pid=4068): Terminated {rc=256} 00:55:26.484036 --- ParallelTerminationStrategy: PID 4069 died... 00:55:26.503650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4069): Terminated: ok {rc=0} 00:55:26.550108 --- ParallelTerminationStrategy: PID 4070 died... 00:55:26.569764 run iperf3-srv_10.42.42.10(pid=4070): Terminated {rc=256} 00:55:26.616336 --- ParallelTerminationStrategy: PID 4073 died... 00:55:26.636038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4073): Terminated: ok {rc=0} 00:55:26.682836 --- ParallelTerminationStrategy: PID 4076 died... 00:55:26.702406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4076): Terminated: ok {rc=0} 00:55:26.748767 --- ParallelTerminationStrategy: PID 4079 died... 00:55:26.768839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4079): Terminated: ok {rc=0} 00:55:26.857718 bus /gobi_0: Setting Powered False 00:55:27.957970 bus /gobi_0: Setting Powered False 00:55:29.075632 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:55:30.220909 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:30.232458 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:30.270141 tst iperf3.py: using LAC 17944 00:55:30.403111 tst iperf3.py: using RAC 94 00:55:30.528525 tst iperf3.py: using CellId 17944 00:55:30.655809 tst iperf3.py: using BVCI 17945 00:55:30.773227 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:30.784436 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:30.795603 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:30.806718 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:30.819419 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:30.843990 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:30.859838 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:30.874973 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:30.890578 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:31.018136 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:55:31.242610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:31.577244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4081): Launched 00:55:31.878373 run iperf3-srv_10.42.42.10(pid=4082): Launched 00:55:32.015827 tst iperf3.py:8: start network... 00:55:32.237406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:32.739236 run create_hlr_db(pid=4083): Launched 00:55:32.870913 bus /gobi_6: Setting Powered False 00:55:33.934948 run create_hlr_db(pid=4083): Terminated: ok {rc=0} 00:55:34.366390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4085): Launched 00:55:34.670697 run osmo-hlr_10.42.42.2(pid=4086): Launched 00:55:34.787119 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:35.323391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4088): Launched 00:55:35.628247 run osmo-stp_10.42.42.5(pid=4089): Launched 00:55:35.744606 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:36.270563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4091): Launched 00:55:36.386909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:36.643774 run patchelf(pid=4092): Launched 00:55:36.812461 run osmo-stp_10.42.42.5(pid=4089): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4089)] 00:55:36.941100 run osmo-stp_10.42.42.5(pid=4089): stdout: | (launched: 2022-12-09_00:55:35.571455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:37.071096 run osmo-stp_10.42.42.5(pid=4089): stderr: | 20221209005535742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005535743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005535743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005535743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005535745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005535746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005535746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:37.201335 run osmo-stp_10.42.42.5(pid=4089): stdout: | (launched: 2022-12-09_00:55:35.571455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:37.325403 run osmo-stp_10.42.42.5(pid=4089): stderr: | 20221209005535742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005535743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005535743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005535743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005535745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005535746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005535746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:37.472152 run patchelf(pid=4092): Terminating (SIGINT) 00:55:37.642887 run patchelf(pid=4092): Terminated: ok {rc=0} 00:55:37.766076 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4089): Process ended prematurely: osmo-stp_10.42.42.5(pid=4089) [trial-2352↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4089)] [trial-2352↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 00:55:37.775542 tst iperf3.py:8: Test FAILED (7.6 sec) 00:55:37.803295 run osmo-hlr_10.42.42.2(pid=4086): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4086)] 00:55:37.851577 run osmo-hlr_10.42.42.2(pid=4086): stdout: | (launched: 2022-12-09_00:55:34.613833) 00:55:37.901730 run osmo-hlr_10.42.42.2(pid=4086): stderr: | 20221209005534793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005534793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005534793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005534793 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005534793 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005534793 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005534805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005534814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005534814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005534814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:37.952349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4081): Terminating (SIGTERM) 00:55:37.993073 run iperf3-srv_10.42.42.10(pid=4082): Terminating (SIGTERM) 00:55:38.033415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4085): Terminating (SIGTERM) 00:55:38.073910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4088): Terminating (SIGTERM) 00:55:38.114267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4091): Terminating (SIGTERM) 00:55:38.154723 --- ParallelTerminationStrategy: PID 4081 died... 00:55:38.173836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4081): Terminated: ok {rc=0} 00:55:38.218857 --- ParallelTerminationStrategy: PID 4082 died... 00:55:38.237543 run iperf3-srv_10.42.42.10(pid=4082): Terminated {rc=256} 00:55:38.282190 --- ParallelTerminationStrategy: PID 4085 died... 00:55:38.301189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4085): Terminated: ok {rc=0} 00:55:38.345879 --- ParallelTerminationStrategy: PID 4088 died... 00:55:38.364585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4088): Terminated: ok {rc=0} 00:55:38.409576 --- ParallelTerminationStrategy: PID 4091 died... 00:55:38.428369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4091): Terminated: ok {rc=0} 00:55:38.516612 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:55:39.664395 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:39.675968 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:39.714414 tst iperf3m4.py: using LAC 17945 00:55:39.834358 tst iperf3m4.py: using RAC 95 00:55:39.952764 tst iperf3m4.py: using CellId 17945 00:55:40.080507 tst iperf3m4.py: using BVCI 17946 00:55:40.192572 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:40.203598 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:40.214531 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:40.225891 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:40.236786 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:40.247745 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:40.259046 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:40.270122 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:40.281444 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:40.398347 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:40.516162 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:40.634182 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:40.748702 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:55:40.950629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:41.255632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4093): Launched 00:55:41.519828 run iperf3-srv_10.42.42.10(pid=4094): Launched 00:55:41.634760 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:55:41.836626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:42.141176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4095): Launched 00:55:42.405797 run iperf3-srv_10.42.42.10(pid=4096): Launched 00:55:42.519857 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:55:42.723235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:43.029310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4097): Launched 00:55:43.294295 run iperf3-srv_10.42.42.10(pid=4098): Launched 00:55:43.407915 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:55:43.616632 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:43.943483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4099): Launched 00:55:44.226357 run iperf3-srv_10.42.42.10(pid=4100): Launched 00:55:44.349839 tst iperf3m4.py:8: start network... 00:55:44.568687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:45.071338 run create_hlr_db(pid=4101): Launched 00:55:45.203876 bus /gobi_6: Setting Powered False 00:55:46.263440 run create_hlr_db(pid=4101): Terminated: ok {rc=0} 00:55:46.732459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4103): Launched 00:55:47.071088 run osmo-hlr_10.42.42.2(pid=4104): Launched 00:55:47.231193 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:47.792606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4106): Launched 00:55:48.119112 run osmo-stp_10.42.42.5(pid=4107): Launched 00:55:48.244049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:48.806906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4109): Launched 00:55:48.934442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:49.209639 run patchelf(pid=4110): Launched 00:55:49.392214 run osmo-stp_10.42.42.5(pid=4107): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4107)] 00:55:49.530526 run osmo-stp_10.42.42.5(pid=4107): stdout: | (launched: 2022-12-09_00:55:48.059228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:49.671102 run osmo-stp_10.42.42.5(pid=4107): stderr: | 20221209005548252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005548252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005548252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005548253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005548253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005548253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005548253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:49.811446 run osmo-stp_10.42.42.5(pid=4107): stdout: | (launched: 2022-12-09_00:55:48.059228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:49.944818 run osmo-stp_10.42.42.5(pid=4107): stderr: | 20221209005548252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005548252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005548252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005548253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005548253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005548253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005548253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:50.102823 run patchelf(pid=4110): Terminating (SIGINT) 00:55:50.285163 run patchelf(pid=4110): Terminated: ok {rc=0} 00:55:50.416725 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4107): Process ended prematurely: osmo-stp_10.42.42.5(pid=4107) [trial-2352↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4107)] [trial-2352↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 00:55:50.427280 tst iperf3m4.py:8: Test FAILED (10.8 sec) 00:55:50.456405 run osmo-hlr_10.42.42.2(pid=4104): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4104)] 00:55:50.506879 run osmo-hlr_10.42.42.2(pid=4104): stdout: | (launched: 2022-12-09_00:55:47.010999) 00:55:50.559218 run osmo-hlr_10.42.42.2(pid=4104): stderr: | 20221209005547240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005547240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005547240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005547241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005547241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005547241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005547252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005547261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005547261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005547261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:50.612308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4093): Terminating (SIGTERM) 00:55:50.654846 run iperf3-srv_10.42.42.10(pid=4094): Terminating (SIGTERM) 00:55:50.698494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4095): Terminating (SIGTERM) 00:55:50.741431 run iperf3-srv_10.42.42.10(pid=4096): Terminating (SIGTERM) 00:55:50.783825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4097): Terminating (SIGTERM) 00:55:50.826430 run iperf3-srv_10.42.42.10(pid=4098): Terminating (SIGTERM) 00:55:50.868778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4099): Terminating (SIGTERM) 00:55:50.911216 run iperf3-srv_10.42.42.10(pid=4100): Terminating (SIGTERM) 00:55:50.953558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4103): Terminating (SIGTERM) 00:55:50.995827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4106): Terminating (SIGTERM) 00:55:51.038112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4109): Terminating (SIGTERM) 00:55:51.081160 --- ParallelTerminationStrategy: PID 4093 died... 00:55:51.101399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4093): Terminated: ok {rc=0} 00:55:51.148711 --- ParallelTerminationStrategy: PID 4094 died... 00:55:51.168664 run iperf3-srv_10.42.42.10(pid=4094): Terminated {rc=256} 00:55:51.215879 --- ParallelTerminationStrategy: PID 4095 died... 00:55:51.235671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4095): Terminated: ok {rc=0} 00:55:51.283062 --- ParallelTerminationStrategy: PID 4096 died... 00:55:51.302944 run iperf3-srv_10.42.42.10(pid=4096): Terminated {rc=256} 00:55:51.350082 --- ParallelTerminationStrategy: PID 4097 died... 00:55:51.369881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4097): Terminated: ok {rc=0} 00:55:51.417156 --- ParallelTerminationStrategy: PID 4098 died... 00:55:51.436935 run iperf3-srv_10.42.42.10(pid=4098): Terminated {rc=256} 00:55:51.483823 --- ParallelTerminationStrategy: PID 4099 died... 00:55:51.503661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4099): Terminated: ok {rc=0} 00:55:51.550765 --- ParallelTerminationStrategy: PID 4100 died... 00:55:51.570857 run iperf3-srv_10.42.42.10(pid=4100): Terminated {rc=256} 00:55:51.618184 --- ParallelTerminationStrategy: PID 4103 died... 00:55:51.638054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4103): Terminated: ok {rc=0} 00:55:51.685170 --- ParallelTerminationStrategy: PID 4106 died... 00:55:51.705080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4106): Terminated: ok {rc=0} 00:55:51.751940 --- ParallelTerminationStrategy: PID 4109 died... 00:55:51.771901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4109): Terminated: ok {rc=0} 00:55:51.861546 bus /gobi_4: Setting Powered False 00:55:52.963475 bus /gobi_4: Setting Powered False 00:55:54.081593 bus /gobi_1: Setting Powered False 00:55:55.178699 bus /gobi_1: Setting Powered False 00:55:56.294977 bus /gobi_0: Setting Powered False 00:55:57.395334 bus /gobi_0: Setting Powered False 00:55:58.514486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 00:55:59.617714 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:59.629738 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:59.668911 tst ping.py: using LAC 17946 00:55:59.796042 tst ping.py: using RAC 96 00:55:59.920230 tst ping.py: using CellId 17946 00:56:00.044664 tst ping.py: using BVCI 17947 00:56:00.159596 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:00.170874 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:00.182014 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:00.193272 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:00.204358 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:00.215685 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:00.226896 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:00.238158 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:56:00.355594 tst ping.py:19: start network... 00:56:00.569900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:01.065374 run create_hlr_db(pid=4111): Launched 00:56:01.224233 bus /gobi_6: Setting Powered False 00:56:02.309965 run create_hlr_db(pid=4111): Terminated: ok {rc=0} 00:56:02.767726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4113): Launched 00:56:03.066448 run osmo-hlr_10.42.42.2(pid=4114): Launched 00:56:03.182189 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:03.696477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4116): Launched 00:56:03.995872 run osmo-stp_10.42.42.5(pid=4117): Launched 00:56:04.110078 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:04.626300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4119): Launched 00:56:04.740180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:04.991981 run patchelf(pid=4120): Launched 00:56:05.158219 run osmo-stp_10.42.42.5(pid=4117): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4117)] 00:56:05.285133 run osmo-stp_10.42.42.5(pid=4117): stdout: | (launched: 2022-12-09_00:56:03.940200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:05.413453 run osmo-stp_10.42.42.5(pid=4117): stderr: | 20221209005604113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005604113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005604114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005604114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005604114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005604114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005604115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:05.542308 run osmo-stp_10.42.42.5(pid=4117): stdout: | (launched: 2022-12-09_00:56:03.940200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:05.664597 run osmo-stp_10.42.42.5(pid=4117): stderr: | 20221209005604113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005604113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005604114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005604114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005604114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005604114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005604115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:05.811113 run patchelf(pid=4120): Terminating (SIGINT) 00:56:05.979512 run patchelf(pid=4120): Terminated: ok {rc=0} 00:56:06.100772 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4117): Process ended prematurely: osmo-stp_10.42.42.5(pid=4117) [trial-2352↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4117)] [trial-2352↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 00:56:06.109826 tst ping.py:22: Test FAILED (6.5 sec) 00:56:06.137608 run osmo-hlr_10.42.42.2(pid=4114): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4114)] 00:56:06.186470 run osmo-hlr_10.42.42.2(pid=4114): stdout: | (launched: 2022-12-09_00:56:03.011055) 00:56:06.236594 run osmo-hlr_10.42.42.2(pid=4114): stderr: | 20221209005603188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005603188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005603188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005603188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005603188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005603189 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005603200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005603210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005603210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005603210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:06.287388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4113): Terminating (SIGTERM) 00:56:06.328253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4116): Terminating (SIGTERM) 00:56:06.369169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4119): Terminating (SIGTERM) 00:56:06.410939 --- ParallelTerminationStrategy: PID 4113 died... 00:56:06.430702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4113): Terminated: ok {rc=0} 00:56:06.475875 --- ParallelTerminationStrategy: PID 4116 died... 00:56:06.494663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4116): Terminated: ok {rc=0} 00:56:06.539578 --- ParallelTerminationStrategy: PID 4119 died... 00:56:06.558534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4119): Terminated: ok {rc=0} 00:56:06.646021 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:56:07.734311 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:07.745836 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:56:07.784874 tst ping_idle_ping.py: using LAC 17947 00:56:07.904671 tst ping_idle_ping.py: using RAC 97 00:56:08.024155 tst ping_idle_ping.py: using CellId 17947 00:56:08.146241 tst ping_idle_ping.py: using BVCI 17948 00:56:08.255383 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:08.266367 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:08.276928 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:08.287727 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:08.298399 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:08.309091 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:08.319920 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:56:08.330613 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:56:08.448587 tst ping_idle_ping.py:24: start network... 00:56:08.665346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:09.161811 run create_hlr_db(pid=4121): Launched 00:56:09.280682 bus /gobi_6: Setting Powered False 00:56:10.340249 run create_hlr_db(pid=4121): Terminated: ok {rc=0} 00:56:10.759639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4123): Launched 00:56:11.060587 run osmo-hlr_10.42.42.2(pid=4124): Launched 00:56:11.175310 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:11.702329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4126): Launched 00:56:12.000835 run osmo-stp_10.42.42.5(pid=4127): Launched 00:56:12.116114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:12.632066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4129): Launched 00:56:12.746643 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:12.999339 run patchelf(pid=4130): Launched 00:56:13.166494 run osmo-stp_10.42.42.5(pid=4127): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4127)] 00:56:13.294035 run osmo-stp_10.42.42.5(pid=4127): stdout: | (launched: 2022-12-09_00:56:11.946085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:13.423065 run osmo-stp_10.42.42.5(pid=4127): stderr: | 20221209005612114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005612114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005612114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005612115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005612115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005612115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005612115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:13.551934 run osmo-stp_10.42.42.5(pid=4127): stdout: | (launched: 2022-12-09_00:56:11.946085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:13.674751 run osmo-stp_10.42.42.5(pid=4127): stderr: | 20221209005612114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005612114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005612114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005612115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005612115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005612115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005612115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:13.820058 run patchelf(pid=4130): Terminating (SIGINT) 00:56:13.987824 run patchelf(pid=4130): Terminated: ok {rc=0} 00:56:14.108859 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4127): Process ended prematurely: osmo-stp_10.42.42.5(pid=4127) [trial-2352↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4127)] [trial-2352↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 00:56:14.118024 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:56:14.145648 run osmo-hlr_10.42.42.2(pid=4124): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4124)] 00:56:14.194416 run osmo-hlr_10.42.42.2(pid=4124): stdout: | (launched: 2022-12-09_00:56:11.004667) 00:56:14.244655 run osmo-hlr_10.42.42.2(pid=4124): stderr: | 20221209005611183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005611183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005611183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005611183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005611183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005611183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005611195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005611204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005611204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005611204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:14.295624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4123): Terminating (SIGTERM) 00:56:14.336498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4126): Terminating (SIGTERM) 00:56:14.377093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4129): Terminating (SIGTERM) 00:56:14.418295 --- ParallelTerminationStrategy: PID 4123 died... 00:56:14.437480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4123): Terminated: ok {rc=0} 00:56:14.482567 --- ParallelTerminationStrategy: PID 4126 died... 00:56:14.501380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4126): Terminated: ok {rc=0} 00:56:14.546413 --- ParallelTerminationStrategy: PID 4129 died... 00:56:14.565352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4129): Terminated: ok {rc=0} 00:56:14.651505 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:56:15.960530 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:56:15.967097 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:56:15.990095 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:56:16.030532 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:56:16.122940 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:56:16.152800 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:56:16.205992 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:56:16.801404 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:56:16.854110 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:16.865962 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:16.924041 tst cs_paging_gprs_active.py: using LAC 17948 00:56:17.101592 tst cs_paging_gprs_active.py: using RAC 98 00:56:17.230831 tst cs_paging_gprs_active.py: using CellId 17948 00:56:17.370454 tst cs_paging_gprs_active.py: using BVCI 17949 00:56:17.489880 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:17.501490 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:17.512633 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:17.524198 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:17.535517 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:17.546990 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:17.558589 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:17.569776 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:17.581253 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:17.696085 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:17.815115 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:56:18.035680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:18.361405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4134): Launched 00:56:18.646343 run iperf3-srv_10.42.42.10(pid=4135): Launched 00:56:18.770604 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:56:18.990235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:19.318019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4136): Launched 00:56:19.602454 run iperf3-srv_10.42.42.10(pid=4137): Launched 00:56:19.726702 tst cs_paging_gprs_active.py:38: start network... 00:56:19.946672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:20.452799 run create_hlr_db(pid=4138): Launched 00:56:20.584630 bus /gobi_6: Setting Powered False 00:56:21.649202 run create_hlr_db(pid=4138): Terminated: ok {rc=0} 00:56:22.084510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4140): Launched 00:56:22.391507 run osmo-hlr_10.42.42.2(pid=4141): Launched 00:56:22.508688 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:23.048025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4143): Launched 00:56:23.374632 run osmo-stp_10.42.42.5(pid=4144): Launched 00:56:23.499294 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:24.061884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4146): Launched 00:56:24.187149 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:24.464085 run patchelf(pid=4147): Launched 00:56:24.648071 run osmo-stp_10.42.42.5(pid=4144): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4144)] 00:56:24.786551 run osmo-stp_10.42.42.5(pid=4144): stdout: | (launched: 2022-12-09_00:56:23.314795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:24.927675 run osmo-stp_10.42.42.5(pid=4144): stderr: | 20221209005623510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005623510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005623510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005623510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005623511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005623511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005623511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:25.068180 run osmo-stp_10.42.42.5(pid=4144): stdout: | (launched: 2022-12-09_00:56:23.314795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:25.201921 run osmo-stp_10.42.42.5(pid=4144): stderr: | 20221209005623510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005623510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005623510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005623510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005623511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005623511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005623511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:25.360021 run patchelf(pid=4147): Terminating (SIGINT) 00:56:25.542661 run patchelf(pid=4147): Terminated: ok {rc=0} 00:56:25.675206 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4144): Process ended prematurely: osmo-stp_10.42.42.5(pid=4144) [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4144)] [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:56:25.685353 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 00:56:25.714066 run osmo-hlr_10.42.42.2(pid=4141): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4141)] 00:56:25.764384 run osmo-hlr_10.42.42.2(pid=4141): stdout: | (launched: 2022-12-09_00:56:22.334459) 00:56:25.816576 run osmo-hlr_10.42.42.2(pid=4141): stderr: | 20221209005622510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005622510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005622510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005622510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005622511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005622511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005622523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005622531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005622531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005622531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:25.869349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4134): Terminating (SIGTERM) 00:56:25.911418 run iperf3-srv_10.42.42.10(pid=4135): Terminating (SIGTERM) 00:56:25.953891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4136): Terminating (SIGTERM) 00:56:25.996308 run iperf3-srv_10.42.42.10(pid=4137): Terminating (SIGTERM) 00:56:26.038364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4140): Terminating (SIGTERM) 00:56:26.080746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4143): Terminating (SIGTERM) 00:56:26.123481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4146): Terminating (SIGTERM) 00:56:26.165778 --- ParallelTerminationStrategy: PID 4134 died... 00:56:26.185821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4134): Terminated: ok {rc=0} 00:56:26.232556 --- ParallelTerminationStrategy: PID 4135 died... 00:56:26.252161 run iperf3-srv_10.42.42.10(pid=4135): Terminated {rc=256} 00:56:26.298473 --- ParallelTerminationStrategy: PID 4136 died... 00:56:26.318065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4136): Terminated: ok {rc=0} 00:56:26.364520 --- ParallelTerminationStrategy: PID 4137 died... 00:56:26.383998 run iperf3-srv_10.42.42.10(pid=4137): Terminated {rc=256} 00:56:26.430266 --- ParallelTerminationStrategy: PID 4140 died... 00:56:26.450006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4140): Terminated: ok {rc=0} 00:56:26.496205 --- ParallelTerminationStrategy: PID 4143 died... 00:56:26.515790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4143): Terminated: ok {rc=0} 00:56:26.562119 --- ParallelTerminationStrategy: PID 4146 died... 00:56:26.581778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4146): Terminated: ok {rc=0} 00:56:26.670017 bus /gobi_0: Setting Powered False 00:56:27.770924 bus /gobi_0: Setting Powered False 00:56:28.886748 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:56:30.036552 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:30.048698 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:30.109864 tst iperf3.py: using LAC 17949 00:56:30.238447 tst iperf3.py: using RAC 99 00:56:30.372508 tst iperf3.py: using CellId 17949 00:56:30.498876 tst iperf3.py: using BVCI 17950 00:56:30.617217 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:30.628467 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:30.639495 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:30.650834 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:30.662011 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:30.673308 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:30.684619 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:30.695711 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:30.707150 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:30.827361 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:56:31.042050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:31.358880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4148): Launched 00:56:31.645457 run iperf3-srv_10.42.42.10(pid=4149): Launched 00:56:31.819347 tst iperf3.py:8: start network... 00:56:32.031738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:32.508820 run create_hlr_db(pid=4150): Launched 00:56:32.626281 bus /gobi_6: Setting Powered False 00:56:33.685868 run create_hlr_db(pid=4150): Terminated: ok {rc=0} 00:56:34.130113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4152): Launched 00:56:34.456687 run osmo-hlr_10.42.42.2(pid=4153): Launched 00:56:34.581497 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:35.142380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4155): Launched 00:56:35.468189 run osmo-stp_10.42.42.5(pid=4156): Launched 00:56:35.591909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:36.152664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4158): Launched 00:56:36.277397 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:36.552063 run patchelf(pid=4159): Launched 00:56:36.735170 run osmo-stp_10.42.42.5(pid=4156): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4156)] 00:56:36.873197 run osmo-stp_10.42.42.5(pid=4156): stdout: | (launched: 2022-12-09_00:56:35.408024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:37.012321 run osmo-stp_10.42.42.5(pid=4156): stderr: | 20221209005635601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005635602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005635602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005635602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005635603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005635603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005635603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:37.151581 run osmo-stp_10.42.42.5(pid=4156): stdout: | (launched: 2022-12-09_00:56:35.408024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:37.284353 run osmo-stp_10.42.42.5(pid=4156): stderr: | 20221209005635601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005635602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005635602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005635602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005635603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005635603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005635603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:37.443218 run patchelf(pid=4159): Terminating (SIGINT) 00:56:37.625554 run patchelf(pid=4159): Terminated: ok {rc=0} 00:56:37.756853 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4156): Process ended prematurely: osmo-stp_10.42.42.5(pid=4156) [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4156)] [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 00:56:37.767343 tst iperf3.py:8: Test FAILED (7.8 sec) 00:56:37.795734 run osmo-hlr_10.42.42.2(pid=4153): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4153)] 00:56:37.845451 run osmo-hlr_10.42.42.2(pid=4153): stdout: | (launched: 2022-12-09_00:56:34.396562) 00:56:37.897389 run osmo-hlr_10.42.42.2(pid=4153): stderr: | 20221209005634596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005634596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005634596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005634596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005634596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005634596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005634609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005634617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005634617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005634617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:37.949852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4148): Terminating (SIGTERM) 00:56:37.991920 run iperf3-srv_10.42.42.10(pid=4149): Terminating (SIGTERM) 00:56:38.034279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4152): Terminating (SIGTERM) 00:56:38.076726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4155): Terminating (SIGTERM) 00:56:38.118651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4158): Terminating (SIGTERM) 00:56:38.160855 --- ParallelTerminationStrategy: PID 4148 died... 00:56:38.181034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4148): Terminated: ok {rc=0} 00:56:38.227678 --- ParallelTerminationStrategy: PID 4149 died... 00:56:38.247412 run iperf3-srv_10.42.42.10(pid=4149): Terminated {rc=256} 00:56:38.293873 --- ParallelTerminationStrategy: PID 4152 died... 00:56:38.313492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4152): Terminated: ok {rc=0} 00:56:38.359560 --- ParallelTerminationStrategy: PID 4155 died... 00:56:38.379214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4155): Terminated: ok {rc=0} 00:56:38.425729 --- ParallelTerminationStrategy: PID 4158 died... 00:56:38.445514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4158): Terminated: ok {rc=0} 00:56:38.534152 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:56:39.685160 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:39.697222 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:39.755924 tst iperf3m4.py: using LAC 17950 00:56:39.884926 tst iperf3m4.py: using RAC 100 00:56:40.011244 tst iperf3m4.py: using CellId 17950 00:56:40.134308 tst iperf3m4.py: using BVCI 17951 00:56:40.246618 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:40.257641 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:40.268346 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:40.279861 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:40.290854 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:40.301671 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:40.312624 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:40.323286 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:40.334256 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:40.453592 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:40.575779 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:40.697482 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:40.817908 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:56:41.037600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:41.364200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4160): Launched 00:56:41.649793 run iperf3-srv_10.42.42.10(pid=4161): Launched 00:56:41.772464 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:56:41.992314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:42.321066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4162): Launched 00:56:42.605426 run iperf3-srv_10.42.42.10(pid=4163): Launched 00:56:42.728336 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:56:42.948655 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:43.277409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4164): Launched 00:56:43.563221 run iperf3-srv_10.42.42.10(pid=4165): Launched 00:56:43.685949 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:56:43.905109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:44.232924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4166): Launched 00:56:44.518490 run iperf3-srv_10.42.42.10(pid=4167): Launched 00:56:44.642466 tst iperf3m4.py:8: start network... 00:56:44.862139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:45.367042 run create_hlr_db(pid=4168): Launched 00:56:45.500305 bus /gobi_6: Setting Powered False 00:56:46.563249 run create_hlr_db(pid=4168): Terminated: ok {rc=0} 00:56:47.027254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4170): Launched 00:56:47.367100 run osmo-hlr_10.42.42.2(pid=4171): Launched 00:56:47.493126 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:48.054754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4173): Launched 00:56:48.383072 run osmo-stp_10.42.42.5(pid=4174): Launched 00:56:48.509696 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:49.074437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4176): Launched 00:56:49.199621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:49.476597 run patchelf(pid=4177): Launched 00:56:49.659272 run osmo-stp_10.42.42.5(pid=4174): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4174)] 00:56:49.798191 run osmo-stp_10.42.42.5(pid=4174): stdout: | (launched: 2022-12-09_00:56:48.322936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:49.938237 run osmo-stp_10.42.42.5(pid=4174): stderr: | 20221209005648517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005648517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005648518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005648518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005648519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005648519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005648519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:50.078220 run osmo-stp_10.42.42.5(pid=4174): stdout: | (launched: 2022-12-09_00:56:48.322936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:50.212624 run osmo-stp_10.42.42.5(pid=4174): stderr: | 20221209005648517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005648517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005648518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005648518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005648519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005648519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005648519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:50.371012 run patchelf(pid=4177): Terminating (SIGINT) 00:56:50.553583 run patchelf(pid=4177): Terminated: ok {rc=0} 00:56:50.685957 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4174): Process ended prematurely: osmo-stp_10.42.42.5(pid=4174) [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4174)] [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:56:50.696101 tst iperf3m4.py:8: Test FAILED (11.0 sec) 00:56:50.725036 run osmo-hlr_10.42.42.2(pid=4171): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4171)] 00:56:50.775517 run osmo-hlr_10.42.42.2(pid=4171): stdout: | (launched: 2022-12-09_00:56:47.307018) 00:56:50.827926 run osmo-hlr_10.42.42.2(pid=4171): stderr: | 20221209005647508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005647508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005647508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005647508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005647508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005647508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005647520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005647529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005647529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005647529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:50.880647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4160): Terminating (SIGTERM) 00:56:50.922970 run iperf3-srv_10.42.42.10(pid=4161): Terminating (SIGTERM) 00:56:50.965126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4162): Terminating (SIGTERM) 00:56:51.007422 run iperf3-srv_10.42.42.10(pid=4163): Terminating (SIGTERM) 00:56:51.049372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4164): Terminating (SIGTERM) 00:56:51.091609 run iperf3-srv_10.42.42.10(pid=4165): Terminating (SIGTERM) 00:56:51.133659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4166): Terminating (SIGTERM) 00:56:51.175918 run iperf3-srv_10.42.42.10(pid=4167): Terminating (SIGTERM) 00:56:51.218006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4170): Terminating (SIGTERM) 00:56:51.260181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4173): Terminating (SIGTERM) 00:56:51.302191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4176): Terminating (SIGTERM) 00:56:51.344607 --- ParallelTerminationStrategy: PID 4160 died... 00:56:51.364699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4160): Terminated: ok {rc=0} 00:56:51.411495 --- ParallelTerminationStrategy: PID 4161 died... 00:56:51.431319 run iperf3-srv_10.42.42.10(pid=4161): Terminated {rc=256} 00:56:51.477766 --- ParallelTerminationStrategy: PID 4162 died... 00:56:51.497498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4162): Terminated: ok {rc=0} 00:56:51.543993 --- ParallelTerminationStrategy: PID 4163 died... 00:56:51.563700 run iperf3-srv_10.42.42.10(pid=4163): Terminated {rc=256} 00:56:51.609913 --- ParallelTerminationStrategy: PID 4164 died... 00:56:51.629967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4164): Terminated: ok {rc=0} 00:56:51.676435 --- ParallelTerminationStrategy: PID 4165 died... 00:56:51.696146 run iperf3-srv_10.42.42.10(pid=4165): Terminated {rc=256} 00:56:51.742575 --- ParallelTerminationStrategy: PID 4166 died... 00:56:51.762452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4166): Terminated: ok {rc=0} 00:56:51.809082 --- ParallelTerminationStrategy: PID 4167 died... 00:56:51.828859 run iperf3-srv_10.42.42.10(pid=4167): Terminated {rc=256} 00:56:51.875075 --- ParallelTerminationStrategy: PID 4170 died... 00:56:51.895005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4170): Terminated: ok {rc=0} 00:56:51.941413 --- ParallelTerminationStrategy: PID 4173 died... 00:56:51.961133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4173): Terminated: ok {rc=0} 00:56:52.007490 --- ParallelTerminationStrategy: PID 4176 died... 00:56:52.027190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4176): Terminated: ok {rc=0} 00:56:52.115430 bus /gobi_4: Setting Powered False 00:56:53.216882 bus /gobi_4: Setting Powered False 00:56:54.334578 bus /gobi_1: Setting Powered False 00:56:55.434597 bus /gobi_1: Setting Powered False 00:56:56.552897 bus /gobi_0: Setting Powered False 00:56:57.651742 bus /gobi_0: Setting Powered False 00:56:58.768252 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:56:59.870365 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:59.882070 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:59.938371 tst ping.py: using LAC 17951 00:57:00.062784 tst ping.py: using RAC 101 00:57:00.180390 tst ping.py: using CellId 17951 00:57:00.297404 tst ping.py: using BVCI 17952 00:57:00.407499 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:00.418526 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:00.429389 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:00.440466 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:00.451515 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:00.462491 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:00.473834 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:00.484754 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:57:00.599041 tst ping.py:19: start network... 00:57:00.816912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:01.324651 run create_hlr_db(pid=4178): Launched 00:57:01.491798 bus /gobi_6: Setting Powered False 00:57:02.555176 run create_hlr_db(pid=4178): Terminated: ok {rc=0} 00:57:02.983677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4180): Launched 00:57:03.281599 run osmo-hlr_10.42.42.2(pid=4181): Launched 00:57:03.395234 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:03.923092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4183): Launched 00:57:04.220356 run osmo-stp_10.42.42.5(pid=4184): Launched 00:57:04.333899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:04.847845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4186): Launched 00:57:04.962155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:05.214432 run patchelf(pid=4187): Launched 00:57:05.382531 run osmo-stp_10.42.42.5(pid=4184): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4184)] 00:57:05.508879 run osmo-stp_10.42.42.5(pid=4184): stdout: | (launched: 2022-12-09_00:57:04.165299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:05.637324 run osmo-stp_10.42.42.5(pid=4184): stderr: | 20221209005704337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005704338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005704338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005704338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005704339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005704339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005704339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:05.766608 run osmo-stp_10.42.42.5(pid=4184): stdout: | (launched: 2022-12-09_00:57:04.165299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:05.888368 run osmo-stp_10.42.42.5(pid=4184): stderr: | 20221209005704337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005704338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005704338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005704338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005704339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005704339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005704339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:06.033576 run patchelf(pid=4187): Terminating (SIGINT) 00:57:06.201227 run patchelf(pid=4187): Terminated: ok {rc=0} 00:57:06.322544 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4184): Process ended prematurely: osmo-stp_10.42.42.5(pid=4184) [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4184)] [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 00:57:06.331645 tst ping.py:22: Test FAILED (6.5 sec) 00:57:06.359127 run osmo-hlr_10.42.42.2(pid=4181): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4181)] 00:57:06.406747 run osmo-hlr_10.42.42.2(pid=4181): stdout: | (launched: 2022-12-09_00:57:03.226256) 00:57:06.456039 run osmo-hlr_10.42.42.2(pid=4181): stderr: | 20221209005703402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005703402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005703402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005703402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005703402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005703402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005703415 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005703424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005703425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005703425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:06.505927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4180): Terminating (SIGTERM) 00:57:06.546066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4183): Terminating (SIGTERM) 00:57:06.586127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4186): Terminating (SIGTERM) 00:57:06.626328 --- ParallelTerminationStrategy: PID 4180 died... 00:57:06.645397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4180): Terminated: ok {rc=0} 00:57:06.690184 --- ParallelTerminationStrategy: PID 4183 died... 00:57:06.708751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4183): Terminated: ok {rc=0} 00:57:06.753109 --- ParallelTerminationStrategy: PID 4186 died... 00:57:06.771686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4186): Terminated: ok {rc=0} 00:57:06.856541 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:57:07.943443 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:07.955426 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:57:08.015449 tst ping_idle_ping.py: using LAC 17952 00:57:08.142605 tst ping_idle_ping.py: using RAC 102 00:57:08.260496 tst ping_idle_ping.py: using CellId 17952 00:57:08.377914 tst ping_idle_ping.py: using BVCI 17953 00:57:08.489043 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:08.499940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:08.510752 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:08.521923 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:08.532585 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:08.543433 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:08.554576 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:57:08.565455 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:57:08.684172 tst ping_idle_ping.py:24: start network... 00:57:08.884097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:09.348759 run create_hlr_db(pid=4188): Launched 00:57:09.462889 bus /gobi_6: Setting Powered False 00:57:10.523233 run create_hlr_db(pid=4188): Terminated: ok {rc=0} 00:57:10.961901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4190): Launched 00:57:11.282358 run osmo-hlr_10.42.42.2(pid=4191): Launched 00:57:11.406195 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:11.959322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4193): Launched 00:57:12.280507 run osmo-stp_10.42.42.5(pid=4194): Launched 00:57:12.403665 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:12.958952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4196): Launched 00:57:13.083280 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:13.357195 run patchelf(pid=4197): Launched 00:57:13.535898 run osmo-stp_10.42.42.5(pid=4194): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4194)] 00:57:13.672650 run osmo-stp_10.42.42.5(pid=4194): stdout: | (launched: 2022-12-09_00:57:12.221246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:13.810625 run osmo-stp_10.42.42.5(pid=4194): stderr: | 20221209005712414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005712414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005712414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005712415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005712417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005712417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005712417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:13.948621 run osmo-stp_10.42.42.5(pid=4194): stdout: | (launched: 2022-12-09_00:57:12.221246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:14.079976 run osmo-stp_10.42.42.5(pid=4194): stderr: | 20221209005712414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005712414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005712414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005712415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005712417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005712417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005712417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:14.235781 run patchelf(pid=4197): Terminating (SIGINT) 00:57:14.416120 run patchelf(pid=4197): Terminated: ok {rc=0} 00:57:14.546245 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4194): Process ended prematurely: osmo-stp_10.42.42.5(pid=4194) [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4194)] [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:57:14.555745 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:57:14.584062 run osmo-hlr_10.42.42.2(pid=4191): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4191)] 00:57:14.634146 run osmo-hlr_10.42.42.2(pid=4191): stdout: | (launched: 2022-12-09_00:57:11.223411) 00:57:14.686558 run osmo-hlr_10.42.42.2(pid=4191): stderr: | 20221209005711421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005711421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005711421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005711421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005711421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005711421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005711434 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005711442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005711442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005711442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:14.739164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4190): Terminating (SIGTERM) 00:57:14.781397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4193): Terminating (SIGTERM) 00:57:14.823938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4196): Terminating (SIGTERM) 00:57:14.866813 --- ParallelTerminationStrategy: PID 4190 died... 00:57:14.887252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4190): Terminated: ok {rc=0} 00:57:14.934512 --- ParallelTerminationStrategy: PID 4193 died... 00:57:14.954509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4193): Terminated: ok {rc=0} 00:57:15.001568 --- ParallelTerminationStrategy: PID 4196 died... 00:57:15.021624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4196): Terminated: ok {rc=0} 00:57:15.111160 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:57:16.449436 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:57:16.457037 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:57:16.487808 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:57:16.548292 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:57:16.666297 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:57:16.700205 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:57:16.757616 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:57:17.315116 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:57:17.366108 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:17.376751 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:17.434028 tst cs_paging_gprs_active.py: using LAC 17953 00:57:17.554804 tst cs_paging_gprs_active.py: using RAC 103 00:57:17.676150 tst cs_paging_gprs_active.py: using CellId 17953 00:57:17.797643 tst cs_paging_gprs_active.py: using BVCI 17954 00:57:17.917192 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:17.928725 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:17.940075 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:17.951545 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:17.962915 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:17.974380 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:17.986286 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:17.997730 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:18.009323 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:18.126863 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:18.245893 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:57:18.468368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:18.797310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4201): Launched 00:57:19.083476 run iperf3-srv_10.42.42.10(pid=4202): Launched 00:57:19.206138 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:57:19.425478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:19.753560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4203): Launched 00:57:20.039616 run iperf3-srv_10.42.42.10(pid=4204): Launched 00:57:20.162218 tst cs_paging_gprs_active.py:38: start network... 00:57:20.382675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:20.888869 run create_hlr_db(pid=4205): Launched 00:57:21.020719 bus /gobi_6: Setting Powered False 00:57:22.085326 run create_hlr_db(pid=4205): Terminated: ok {rc=0} 00:57:22.521355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4207): Launched 00:57:22.828401 run osmo-hlr_10.42.42.2(pid=4208): Launched 00:57:22.944445 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:23.481747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4210): Launched 00:57:23.788462 run osmo-stp_10.42.42.5(pid=4211): Launched 00:57:23.905243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:24.435358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4213): Launched 00:57:24.552917 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:24.811606 run patchelf(pid=4214): Launched 00:57:24.982527 run osmo-stp_10.42.42.5(pid=4211): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4211)] 00:57:25.112549 run osmo-stp_10.42.42.5(pid=4211): stdout: | (launched: 2022-12-09_00:57:23.731944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:25.244733 run osmo-stp_10.42.42.5(pid=4211): stderr: | 20221209005723904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005723904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005723904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005723905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005723905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005723905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005723905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:25.377283 run osmo-stp_10.42.42.5(pid=4211): stdout: | (launched: 2022-12-09_00:57:23.731944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:25.502847 run osmo-stp_10.42.42.5(pid=4211): stderr: | 20221209005723904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005723904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005723904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005723905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005723905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005723905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005723905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:25.651567 run patchelf(pid=4214): Terminating (SIGINT) 00:57:25.823648 run patchelf(pid=4214): Terminated: ok {rc=0} 00:57:25.947709 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4211): Process ended prematurely: osmo-stp_10.42.42.5(pid=4211) [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4211)] [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:57:25.957419 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 00:57:25.985261 run osmo-hlr_10.42.42.2(pid=4208): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4208)] 00:57:26.033352 run osmo-hlr_10.42.42.2(pid=4208): stdout: | (launched: 2022-12-09_00:57:22.771259) 00:57:26.082890 run osmo-hlr_10.42.42.2(pid=4208): stderr: | 20221209005722947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005722947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005722947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005722947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005722947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005722947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005722959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005722968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005722968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005722968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:26.133225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4201): Terminating (SIGTERM) 00:57:26.173248 run iperf3-srv_10.42.42.10(pid=4202): Terminating (SIGTERM) 00:57:26.213526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4203): Terminating (SIGTERM) 00:57:26.253792 run iperf3-srv_10.42.42.10(pid=4204): Terminating (SIGTERM) 00:57:26.294260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4207): Terminating (SIGTERM) 00:57:26.334627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4210): Terminating (SIGTERM) 00:57:26.374993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4213): Terminating (SIGTERM) 00:57:26.415706 --- ParallelTerminationStrategy: PID 4201 died... 00:57:26.435041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4201): Terminated: ok {rc=0} 00:57:26.479666 --- ParallelTerminationStrategy: PID 4202 died... 00:57:26.498206 run iperf3-srv_10.42.42.10(pid=4202): Terminated {rc=256} 00:57:26.542904 --- ParallelTerminationStrategy: PID 4203 died... 00:57:26.561384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4203): Terminated: ok {rc=0} 00:57:26.605698 --- ParallelTerminationStrategy: PID 4204 died... 00:57:26.624188 run iperf3-srv_10.42.42.10(pid=4204): Terminated {rc=256} 00:57:26.668158 --- ParallelTerminationStrategy: PID 4207 died... 00:57:26.686729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4207): Terminated: ok {rc=0} 00:57:26.730945 --- ParallelTerminationStrategy: PID 4210 died... 00:57:26.749564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4210): Terminated: ok {rc=0} 00:57:26.793687 --- ParallelTerminationStrategy: PID 4213 died... 00:57:26.812424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4213): Terminated: ok {rc=0} 00:57:26.899139 bus /gobi_0: Setting Powered False 00:57:27.998412 bus /gobi_0: Setting Powered False 00:57:29.114585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:57:30.260258 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:30.271670 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:30.331469 tst iperf3.py: using LAC 17954 00:57:30.452361 tst iperf3.py: using RAC 104 00:57:30.575793 tst iperf3.py: using CellId 17954 00:57:30.694710 tst iperf3.py: using BVCI 17955 00:57:30.806330 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:30.817557 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:30.845404 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:30.857666 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:30.869380 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:30.883102 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:30.896135 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:30.908821 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:30.920747 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:31.042097 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:57:31.270165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:31.607932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4216): Launched 00:57:31.913161 run iperf3-srv_10.42.42.10(pid=4217): Launched 00:57:32.052417 tst iperf3.py:8: start network... 00:57:32.278138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:32.784385 run create_hlr_db(pid=4218): Launched 00:57:32.916569 bus /gobi_6: Setting Powered False 00:57:33.980901 run create_hlr_db(pid=4218): Terminated: ok {rc=0} 00:57:34.434889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4220): Launched 00:57:34.761439 run osmo-hlr_10.42.42.2(pid=4221): Launched 00:57:34.887042 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:35.453064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4223): Launched 00:57:35.780349 run osmo-stp_10.42.42.5(pid=4230): Launched 00:57:35.905792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:36.471666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4232): Launched 00:57:36.596665 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:36.872451 run patchelf(pid=4233): Launched 00:57:37.054585 run osmo-stp_10.42.42.5(pid=4230): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4230)] 00:57:37.192839 run osmo-stp_10.42.42.5(pid=4230): stdout: | (launched: 2022-12-09_00:57:35.719559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:37.332498 run osmo-stp_10.42.42.5(pid=4230): stderr: | 20221209005735915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005735915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005735915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005735915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005735916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005735916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005735916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:37.472062 run osmo-stp_10.42.42.5(pid=4230): stdout: | (launched: 2022-12-09_00:57:35.719559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:37.605574 run osmo-stp_10.42.42.5(pid=4230): stderr: | 20221209005735915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005735915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005735915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005735915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005735916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005735916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005735916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:37.764217 run patchelf(pid=4233): Terminating (SIGINT) 00:57:37.946615 run patchelf(pid=4233): Terminated: ok {rc=0} 00:57:38.078376 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4230): Process ended prematurely: osmo-stp_10.42.42.5(pid=4230) [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4230)] [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 00:57:38.088617 tst iperf3.py:8: Test FAILED (7.9 sec) 00:57:38.117307 run osmo-hlr_10.42.42.2(pid=4221): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4221)] 00:57:38.167294 run osmo-hlr_10.42.42.2(pid=4221): stdout: | (launched: 2022-12-09_00:57:34.701804) 00:57:38.219085 run osmo-hlr_10.42.42.2(pid=4221): stderr: | 20221209005734901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005734901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005734901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005734901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005734901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005734901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005734916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005734925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005734925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005734925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:38.271237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4216): Terminating (SIGTERM) 00:57:38.313222 run iperf3-srv_10.42.42.10(pid=4217): Terminating (SIGTERM) 00:57:38.355040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4220): Terminating (SIGTERM) 00:57:38.396915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4223): Terminating (SIGTERM) 00:57:38.438787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4232): Terminating (SIGTERM) 00:57:38.480763 --- ParallelTerminationStrategy: PID 4216 died... 00:57:38.500860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4216): Terminated: ok {rc=0} 00:57:38.547757 --- ParallelTerminationStrategy: PID 4217 died... 00:57:38.567447 run iperf3-srv_10.42.42.10(pid=4217): Terminated {rc=256} 00:57:38.613631 --- ParallelTerminationStrategy: PID 4220 died... 00:57:38.633183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4220): Terminated: ok {rc=0} 00:57:38.679650 --- ParallelTerminationStrategy: PID 4223 died... 00:57:38.699354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4223): Terminated: ok {rc=0} 00:57:38.745489 --- ParallelTerminationStrategy: PID 4232 died... 00:57:38.764853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4232): Terminated: ok {rc=0} 00:57:38.853027 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:57:39.999999 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:40.011603 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:40.068892 tst iperf3m4.py: using LAC 17955 00:57:40.189987 tst iperf3m4.py: using RAC 105 00:57:40.311346 tst iperf3m4.py: using CellId 17955 00:57:40.432091 tst iperf3m4.py: using BVCI 17956 00:57:40.545136 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:40.555897 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:40.566583 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:40.577449 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:40.588215 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:40.599084 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:40.610008 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:40.620705 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:40.631651 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:40.750890 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:40.870231 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:40.989184 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:41.110991 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:57:41.330835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:41.658657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4234): Launched 00:57:41.944545 run iperf3-srv_10.42.42.10(pid=4235): Launched 00:57:42.067144 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:57:42.286266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:42.614799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4236): Launched 00:57:42.899701 run iperf3-srv_10.42.42.10(pid=4237): Launched 00:57:43.024034 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:57:43.243095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:43.570493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4238): Launched 00:57:43.856478 run iperf3-srv_10.42.42.10(pid=4239): Launched 00:57:43.980825 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:57:44.200357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:44.529276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4240): Launched 00:57:44.815463 run iperf3-srv_10.42.42.10(pid=4241): Launched 00:57:44.937977 tst iperf3m4.py:8: start network... 00:57:45.158311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:45.664842 run create_hlr_db(pid=4242): Launched 00:57:45.796834 bus /gobi_6: Setting Powered False 00:57:46.860193 run create_hlr_db(pid=4242): Terminated: ok {rc=0} 00:57:47.314260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4244): Launched 00:57:47.621440 run osmo-hlr_10.42.42.2(pid=4245): Launched 00:57:47.738831 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:48.281704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4247): Launched 00:57:48.586885 run osmo-stp_10.42.42.5(pid=4248): Launched 00:57:48.705437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:49.232054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4250): Launched 00:57:49.350227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:49.607635 run patchelf(pid=4251): Launched 00:57:49.777206 run osmo-stp_10.42.42.5(pid=4248): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4248)] 00:57:49.906270 run osmo-stp_10.42.42.5(pid=4248): stdout: | (launched: 2022-12-09_00:57:48.530214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:50.036453 run osmo-stp_10.42.42.5(pid=4248): stderr: | 20221209005748704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005748704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005748704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005748705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005748705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005748705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005748705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:50.168673 run osmo-stp_10.42.42.5(pid=4248): stdout: | (launched: 2022-12-09_00:57:48.530214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:50.292503 run osmo-stp_10.42.42.5(pid=4248): stderr: | 20221209005748704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005748704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005748704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005748705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005748705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005748705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005748705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:50.439647 run patchelf(pid=4251): Terminating (SIGINT) 00:57:50.609835 run patchelf(pid=4251): Terminated: ok {rc=0} 00:57:50.733221 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4248): Process ended prematurely: osmo-stp_10.42.42.5(pid=4248) [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4248)] [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:57:50.742737 tst iperf3m4.py:8: Test FAILED (10.8 sec) 00:57:50.770736 run osmo-hlr_10.42.42.2(pid=4245): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4245)] 00:57:50.818717 run osmo-hlr_10.42.42.2(pid=4245): stdout: | (launched: 2022-12-09_00:57:47.564640) 00:57:50.868458 run osmo-hlr_10.42.42.2(pid=4245): stderr: | 20221209005747741 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005747741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005747741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005747741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005747741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005747741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005747753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005747761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005747762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005747762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:50.918625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4234): Terminating (SIGTERM) 00:57:50.958837 run iperf3-srv_10.42.42.10(pid=4235): Terminating (SIGTERM) 00:57:50.998828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4236): Terminating (SIGTERM) 00:57:51.038797 run iperf3-srv_10.42.42.10(pid=4237): Terminating (SIGTERM) 00:57:51.078721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4238): Terminating (SIGTERM) 00:57:51.118656 run iperf3-srv_10.42.42.10(pid=4239): Terminating (SIGTERM) 00:57:51.158638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4240): Terminating (SIGTERM) 00:57:51.198633 run iperf3-srv_10.42.42.10(pid=4241): Terminating (SIGTERM) 00:57:51.238280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4244): Terminating (SIGTERM) 00:57:51.278319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4247): Terminating (SIGTERM) 00:57:51.318131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4250): Terminating (SIGTERM) 00:57:51.358139 --- ParallelTerminationStrategy: PID 4234 died... 00:57:51.377065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4234): Terminated: ok {rc=0} 00:57:51.421351 --- ParallelTerminationStrategy: PID 4235 died... 00:57:51.439678 run iperf3-srv_10.42.42.10(pid=4235): Terminated {rc=256} 00:57:51.484396 --- ParallelTerminationStrategy: PID 4236 died... 00:57:51.502981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4236): Terminated: ok {rc=0} 00:57:51.547198 --- ParallelTerminationStrategy: PID 4237 died... 00:57:51.565672 run iperf3-srv_10.42.42.10(pid=4237): Terminated {rc=256} 00:57:51.609535 --- ParallelTerminationStrategy: PID 4238 died... 00:57:51.628094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4238): Terminated: ok {rc=0} 00:57:51.672090 --- ParallelTerminationStrategy: PID 4239 died... 00:57:51.690477 run iperf3-srv_10.42.42.10(pid=4239): Terminated {rc=256} 00:57:51.734468 --- ParallelTerminationStrategy: PID 4240 died... 00:57:51.752938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4240): Terminated: ok {rc=0} 00:57:51.797046 --- ParallelTerminationStrategy: PID 4241 died... 00:57:51.815577 run iperf3-srv_10.42.42.10(pid=4241): Terminated {rc=256} 00:57:51.859552 --- ParallelTerminationStrategy: PID 4244 died... 00:57:51.878143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4244): Terminated: ok {rc=0} 00:57:51.922595 --- ParallelTerminationStrategy: PID 4247 died... 00:57:51.941126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4247): Terminated: ok {rc=0} 00:57:51.985230 --- ParallelTerminationStrategy: PID 4250 died... 00:57:52.003600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4250): Terminated: ok {rc=0} 00:57:52.087075 bus /gobi_4: Setting Powered False 00:57:53.186117 bus /gobi_4: Setting Powered False 00:57:54.303524 bus /gobi_1: Setting Powered False 00:57:55.402625 bus /gobi_1: Setting Powered False 00:57:56.517901 bus /gobi_0: Setting Powered False 00:57:57.615641 bus /gobi_0: Setting Powered False 00:57:58.731523 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:57:59.834661 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:59.846198 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:59.903950 tst ping.py: using LAC 17956 00:58:00.022783 tst ping.py: using RAC 106 00:58:00.150540 tst ping.py: using CellId 17956 00:58:00.277094 tst ping.py: using BVCI 17957 00:58:00.387426 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:00.398492 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:00.409246 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:00.420587 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:00.432093 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:00.443508 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:00.455107 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:00.466547 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:58:00.582179 tst ping.py:19: start network... 00:58:00.782777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:01.287577 run create_hlr_db(pid=4252): Launched 00:58:01.453608 bus /gobi_6: Setting Powered False 00:58:02.516587 run create_hlr_db(pid=4252): Terminated: ok {rc=0} 00:58:02.953654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4254): Launched 00:58:03.254274 run osmo-hlr_10.42.42.2(pid=4255): Launched 00:58:03.368943 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:03.897824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4257): Launched 00:58:04.198794 run osmo-stp_10.42.42.5(pid=4258): Launched 00:58:04.312677 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:58:04.828689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4260): Launched 00:58:04.943319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:58:05.195331 run patchelf(pid=4261): Launched 00:58:05.362212 run osmo-stp_10.42.42.5(pid=4258): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4258)] 00:58:05.488819 run osmo-stp_10.42.42.5(pid=4258): stdout: | (launched: 2022-12-09_00:58:04.143000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:05.617647 run osmo-stp_10.42.42.5(pid=4258): stderr: | 20221209005804313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005804313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005804313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005804314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005804314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005804314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005804314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:05.746190 run osmo-stp_10.42.42.5(pid=4258): stdout: | (launched: 2022-12-09_00:58:04.143000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:05.868806 run osmo-stp_10.42.42.5(pid=4258): stderr: | 20221209005804313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005804313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005804313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005804314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005804314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005804314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005804314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:06.014118 run patchelf(pid=4261): Terminating (SIGINT) 00:58:06.182321 run patchelf(pid=4261): Terminated: ok {rc=0} 00:58:06.303622 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4258): Process ended prematurely: osmo-stp_10.42.42.5(pid=4258) [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4258)] [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 00:58:06.312646 tst ping.py:22: Test FAILED (6.5 sec) 00:58:06.340166 run osmo-hlr_10.42.42.2(pid=4255): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4255)] 00:58:06.389052 run osmo-hlr_10.42.42.2(pid=4255): stdout: | (launched: 2022-12-09_00:58:03.198691) 00:58:06.439342 run osmo-hlr_10.42.42.2(pid=4255): stderr: | 20221209005803376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005803376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005803376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005803377 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005803377 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005803377 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005803388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005803398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005803398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005803398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:06.490159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4254): Terminating (SIGTERM) 00:58:06.531261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4257): Terminating (SIGTERM) 00:58:06.572075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4260): Terminating (SIGTERM) 00:58:06.613483 --- ParallelTerminationStrategy: PID 4254 died... 00:58:06.632720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4254): Terminated: ok {rc=0} 00:58:06.678141 --- ParallelTerminationStrategy: PID 4257 died... 00:58:06.696915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4257): Terminated: ok {rc=0} 00:58:06.742033 --- ParallelTerminationStrategy: PID 4260 died... 00:58:06.760888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4260): Terminated: ok {rc=0} 00:58:06.847823 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:58:07.937913 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:07.950051 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:58:08.008743 tst ping_idle_ping.py: using LAC 17957 00:58:08.128658 tst ping_idle_ping.py: using RAC 107 00:58:08.246480 tst ping_idle_ping.py: using CellId 17957 00:58:08.366485 tst ping_idle_ping.py: using BVCI 17958 00:58:08.477548 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:08.488304 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:08.498973 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:08.509901 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:08.520626 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:08.531461 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:08.542435 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:58:08.553324 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:58:08.667445 tst ping_idle_ping.py:24: start network... 00:58:08.870747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:09.342404 run create_hlr_db(pid=4263): Launched 00:58:09.459791 bus /gobi_6: Setting Powered False 00:58:10.519196 run create_hlr_db(pid=4263): Terminated: ok {rc=0} 00:58:10.959393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4265): Launched 00:58:11.280332 run osmo-hlr_10.42.42.2(pid=4266): Launched 00:58:11.402776 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:11.959748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4268): Launched 00:58:12.281197 run osmo-stp_10.42.42.5(pid=4269): Launched 00:58:12.403262 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:58:12.955680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4271): Launched 00:58:13.079198 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:58:13.349634 run patchelf(pid=4272): Launched 00:58:13.527996 run osmo-stp_10.42.42.5(pid=4269): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4269)] 00:58:13.664051 run osmo-stp_10.42.42.5(pid=4269): stdout: | (launched: 2022-12-09_00:58:12.221060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:13.802034 run osmo-stp_10.42.42.5(pid=4269): stderr: | 20221209005812412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005812413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005812413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005812413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005812414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005812414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005812414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:13.939221 run osmo-stp_10.42.42.5(pid=4269): stdout: | (launched: 2022-12-09_00:58:12.221060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:14.070404 run osmo-stp_10.42.42.5(pid=4269): stderr: | 20221209005812412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005812413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005812413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005812413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005812414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005812414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005812414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:14.225929 run patchelf(pid=4272): Terminating (SIGINT) 00:58:14.405584 run patchelf(pid=4272): Terminated: ok {rc=0} 00:58:14.535253 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4269): Process ended prematurely: osmo-stp_10.42.42.5(pid=4269) [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4269)] [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:58:14.545146 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:58:14.573297 run osmo-hlr_10.42.42.2(pid=4266): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4266)] 00:58:14.623520 run osmo-hlr_10.42.42.2(pid=4266): stdout: | (launched: 2022-12-09_00:58:11.221484) 00:58:14.675829 run osmo-hlr_10.42.42.2(pid=4266): stderr: | 20221209005811419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005811419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005811419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005811420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005811420 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005811420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005811432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005811440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005811440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005811440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:14.728751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4265): Terminating (SIGTERM) 00:58:14.770958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4268): Terminating (SIGTERM) 00:58:14.813389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4271): Terminating (SIGTERM) 00:58:14.856090 --- ParallelTerminationStrategy: PID 4265 died... 00:58:14.876187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4265): Terminated: ok {rc=0} 00:58:14.922887 --- ParallelTerminationStrategy: PID 4268 died... 00:58:14.942622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4268): Terminated: ok {rc=0} 00:58:14.989071 --- ParallelTerminationStrategy: PID 4271 died... 00:58:15.008693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4271): Terminated: ok {rc=0} 00:58:15.097196 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:58:16.417089 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:16.424620 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:58:16.446699 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:58:16.484083 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:58:16.542676 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:58:16.572530 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:58:16.609219 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:58:17.153740 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:58:17.159913 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:17.172042 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:58:17.230409 tst switch_tch_pdch.py: using LAC 17958 00:58:17.358228 tst switch_tch_pdch.py: using RAC 108 00:58:17.485396 tst switch_tch_pdch.py: using CellId 17958 00:58:17.609613 tst switch_tch_pdch.py: using BVCI 17959 00:58:17.725817 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:17.737637 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:17.748854 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:17.760394 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:17.772001 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:17.783591 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:17.795311 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:17.806836 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:58:17.923399 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:58:18.041674 tst switch_tch_pdch.py:51: start network... 00:58:18.258197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:18.753767 run create_hlr_db(pid=4276): Launched 00:58:18.885667 bus /gobi_6: Setting Powered False 00:58:19.949228 run create_hlr_db(pid=4276): Terminated: ok {rc=0} 00:58:20.378165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4278): Launched 00:58:20.678645 run osmo-hlr_10.42.42.2(pid=4279): Launched 00:58:20.793233 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:21.327089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4281): Launched 00:58:21.625382 run osmo-stp_10.42.42.5(pid=4282): Launched 00:58:21.739254 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:58:22.299739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4284): Launched 00:58:22.422906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:58:22.694507 run patchelf(pid=4285): Launched 00:58:22.874659 run osmo-stp_10.42.42.5(pid=4282): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4282)] 00:58:23.010865 run osmo-stp_10.42.42.5(pid=4282): stdout: | (launched: 2022-12-09_00:58:21.570082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:23.148371 run osmo-stp_10.42.42.5(pid=4282): stderr: | 20221209005821743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005821743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005821743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005821744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005821744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005821744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005821744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:23.285931 run osmo-stp_10.42.42.5(pid=4282): stdout: | (launched: 2022-12-09_00:58:21.570082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:23.417232 run osmo-stp_10.42.42.5(pid=4282): stderr: | 20221209005821743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005821743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005821743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005821744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005821744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005821744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005821744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:23.572707 run patchelf(pid=4285): Terminating (SIGINT) 00:58:23.752220 run patchelf(pid=4285): Terminated: ok {rc=0} 00:58:23.881574 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4282): Process ended prematurely: osmo-stp_10.42.42.5(pid=4282) [trial-2352↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4282)] [trial-2352↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:58:23.891084 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 00:58:23.919340 run osmo-hlr_10.42.42.2(pid=4279): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4279)] 00:58:23.969702 run osmo-hlr_10.42.42.2(pid=4279): stdout: | (launched: 2022-12-09_00:58:20.621834) 00:58:24.021998 run osmo-hlr_10.42.42.2(pid=4279): stderr: | 20221209005820798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005820798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005820798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005820798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005820798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005820798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005820810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005820818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005820818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005820819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:24.074482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4278): Terminating (SIGTERM) 00:58:24.116642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4281): Terminating (SIGTERM) 00:58:24.158947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4284): Terminating (SIGTERM) 00:58:24.201364 --- ParallelTerminationStrategy: PID 4278 died... 00:58:24.221539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4278): Terminated: ok {rc=0} 00:58:24.268220 --- ParallelTerminationStrategy: PID 4281 died... 00:58:24.287828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4281): Terminated: ok {rc=0} 00:58:24.334496 --- ParallelTerminationStrategy: PID 4284 died... 00:58:24.354053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4284): Terminated: ok {rc=0} 00:58:24.442671 bus /gobi_0: Setting Powered False 00:58:25.542414 bus /gobi_0: Setting Powered False 00:58:26.660557 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:58:27.895526 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:27.901303 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:58:27.922105 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:58:27.956667 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:58:28.011114 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:58:28.032330 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:58:28.066789 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:58:28.616836 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:58:28.621910 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:28.632638 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:58:28.689570 tst switch_tch_pdch.py: using LAC 17959 00:58:28.815395 tst switch_tch_pdch.py: using RAC 109 00:58:28.942581 tst switch_tch_pdch.py: using CellId 17959 00:58:29.067502 tst switch_tch_pdch.py: using BVCI 17960 00:58:29.183370 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:29.194956 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:29.206298 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:29.217794 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:29.229271 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:29.240663 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:29.252321 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:29.263882 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:58:29.379273 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:58:29.497374 tst switch_tch_pdch.py:51: start network... 00:58:29.697771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:30.132936 run create_hlr_db(pid=4291): Launched 00:58:30.247143 bus /gobi_6: Setting Powered False 00:58:31.327360 run create_hlr_db(pid=4291): Terminated: ok {rc=0} 00:58:31.824458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4293): Launched 00:58:32.169893 run osmo-hlr_10.42.42.2(pid=4294): Launched 00:58:32.295151 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:32.824271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4296): Launched 00:58:33.145085 run osmo-stp_10.42.42.5(pid=4297): Launched 00:58:33.268300 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:58:33.793377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4299): Launched 00:58:33.915999 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:58:34.187196 run patchelf(pid=4300): Launched 00:58:34.367134 run osmo-stp_10.42.42.5(pid=4297): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4297)] 00:58:34.503158 run osmo-stp_10.42.42.5(pid=4297): stdout: | (launched: 2022-12-09_00:58:33.086233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:34.640693 run osmo-stp_10.42.42.5(pid=4297): stderr: | 20221209005833278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005833279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005833279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005833279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005833282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005833282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005833282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:34.778936 run osmo-stp_10.42.42.5(pid=4297): stdout: | (launched: 2022-12-09_00:58:33.086233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:34.910624 run osmo-stp_10.42.42.5(pid=4297): stderr: | 20221209005833278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005833279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005833279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005833279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005833282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005833282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005833282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:35.067053 run patchelf(pid=4300): Terminating (SIGINT) 00:58:35.245801 run patchelf(pid=4300): Terminated: ok {rc=0} 00:58:35.374974 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4297): Process ended prematurely: osmo-stp_10.42.42.5(pid=4297) [trial-2352↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4297)] [trial-2352↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:58:35.384509 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 00:58:35.412434 run osmo-hlr_10.42.42.2(pid=4294): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4294)] 00:58:35.462836 run osmo-hlr_10.42.42.2(pid=4294): stdout: | (launched: 2022-12-09_00:58:32.109131) 00:58:35.515067 run osmo-hlr_10.42.42.2(pid=4294): stderr: | 20221209005832349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005832349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005832349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005832349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005832349 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005832349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005832365 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005832373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005832374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005832374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:35.567771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4293): Terminating (SIGTERM) 00:58:35.610155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4296): Terminating (SIGTERM) 00:58:35.652397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4299): Terminating (SIGTERM) 00:58:35.695335 --- ParallelTerminationStrategy: PID 4293 died... 00:58:35.715581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4293): Terminated: ok {rc=0} 00:58:35.762208 --- ParallelTerminationStrategy: PID 4296 died... 00:58:35.782265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4296): Terminated: ok {rc=0} 00:58:35.828547 --- ParallelTerminationStrategy: PID 4299 died... 00:58:35.848017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4299): Terminated: ok {rc=0} 00:58:35.936131 bus /gobi_0: Setting Powered False 00:58:37.034123 bus /gobi_0: Setting Powered False 00:58:38.151739 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_sms:trx-b200 --------------------------------------------------------------------- 00:58:39.390458 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:39.394712 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 00:58:39.428751 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 00:58:39.435941 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 00:58:39.492337 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 00:58:39.526251 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 00:58:39.533213 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 00:58:40.067631 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 00:58:40.074013 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 00:58:40.085587 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 00:58:40.135962 tst mo_mt_sms.py: using LAC 17960 00:58:40.261529 tst mo_mt_sms.py: using RAC 110 00:58:40.386807 tst mo_mt_sms.py: using CellId 17960 00:58:40.514332 tst mo_mt_sms.py: using BVCI 17961 00:58:40.630710 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:40.749762 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:40.861900 tst mo_mt_sms.py:9: start nitb and bts... 00:58:41.062642 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:58:41.670143 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4304): Launched 00:58:41.971439 run osmo-nitb_10.42.42.2(pid=4305): Launched 00:58:42.137574 run osmo-nitb_10.42.42.2(pid=4305): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4305)] 00:58:42.271797 run osmo-nitb_10.42.42.2(pid=4305): stdout: | (launched: 2022-12-09_00:58:41.915855) 00:58:42.407931 run osmo-nitb_10.42.42.2(pid=4305): stderr: | (launched: 2022-12-09_00:58:41.960142) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:58:42.543983 run osmo-nitb_10.42.42.2(pid=4305): stdout: | (launched: 2022-12-09_00:58:41.915855) 00:58:42.674305 run osmo-nitb_10.42.42.2(pid=4305): stderr: | (launched: 2022-12-09_00:58:41.960142) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4305) [trial-2352↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4305)] 00:58:43.084282 tst osmo-nitb_10.42.42.2(pid=4305): stdout: | (launched: 2022-12-09_00:58:41.915855) 00:58:43.204541 tst osmo-nitb_10.42.42.2(pid=4305): stderr: | (launched: 2022-12-09_00:58:41.960142) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:58:43.346196 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4305) [trial-2352↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4305)] [trial-2352↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 00:58:43.354449 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 00:58:43.361175 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4304): Terminating (SIGTERM) 00:58:43.570940 --- ParallelTerminationStrategy: PID 4304 died... 00:58:43.591762 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4304): Terminated: ok {rc=0} 00:58:43.678653 bus /sierra_3: Setting Powered False 00:58:44.779187 bus /sierra_3: Setting Powered False 00:58:45.907271 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 sms:trx-b200 --------------------------------------------------------------------- 00:58:47.123757 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:47.128733 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 00:58:47.167308 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 00:58:47.195689 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 00:58:47.247809 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 00:58:47.284324 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 00:58:47.310637 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 00:58:47.852475 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 00:58:47.857478 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:47.867862 tst sms:trx-b200: Using 1 x bts (candidates: 1) 00:58:47.914858 tst mo_mt_sms.py: using LAC 17961 00:58:48.037213 tst mo_mt_sms.py: using RAC 111 00:58:48.154032 tst mo_mt_sms.py: using CellId 17961 00:58:48.271047 tst mo_mt_sms.py: using BVCI 17962 00:58:48.378555 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:48.389133 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:48.399443 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:48.410077 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:48.420572 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:48.431137 tst sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:48.543792 tst sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:48.661523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:49.158014 run create_hlr_db(pid=4310): Launched 00:58:49.289895 bus /sierra_2: Setting Powered False 00:58:50.354344 run create_hlr_db(pid=4310): Terminated: ok {rc=0} 00:58:50.781571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4312): Launched 00:58:51.082342 run osmo-hlr_10.42.42.2(pid=4313): Launched 00:58:51.198767 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:51.728594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4315): Launched 00:58:52.027696 run osmo-stp_10.42.42.5(pid=4316): Launched 00:58:52.141708 run osmo-msc_10.42.42.6: Starting osmo-msc 00:58:52.682599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4318): Launched 00:58:52.981469 run osmo-msc_10.42.42.6(pid=4319): Launched 00:58:53.148624 run osmo-stp_10.42.42.5(pid=4316): ERR: Terminated: ERROR {rc=1} [trial-2352↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4316)] 00:58:53.274409 run osmo-stp_10.42.42.5(pid=4316): stdout: | (launched: 2022-12-09_00:58:51.971851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:53.400666 run osmo-stp_10.42.42.5(pid=4316): stderr: | 20221209005852141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005852141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005852141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005852142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005852142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005852142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005852142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:53.524815 run osmo-stp_10.42.42.5(pid=4316): stdout: | (launched: 2022-12-09_00:58:51.971851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:53.643575 run osmo-stp_10.42.42.5(pid=4316): stderr: | 20221209005852141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005852141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005852141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005852142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005852142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005852142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005852142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:53.785721 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4316): Process ended prematurely: osmo-stp_10.42.42.5(pid=4316) [trial-2352↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4316)] [trial-2352↪sms:trx-b200↪mo_mt_sms.py:16] 00:58:53.794111 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 00:58:53.820853 run osmo-hlr_10.42.42.2(pid=4313): ERR: Terminated: ERROR {rc=237} [trial-2352↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4313)] 00:58:53.869595 run osmo-hlr_10.42.42.2(pid=4313): stdout: | (launched: 2022-12-09_00:58:51.026313) 00:58:53.919972 run osmo-hlr_10.42.42.2(pid=4313): stderr: | 20221209005851205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005851205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005851205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005851205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005851205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005851205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005851217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005851226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005851226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005851226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:53.989662 run osmo-msc_10.42.42.6(pid=4319): ERR: Terminated: ERROR {rc=2} [trial-2352↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4319)] 00:58:54.038017 run osmo-msc_10.42.42.6(pid=4319): stdout: | (launched: 2022-12-09_00:58:52.926237) 00:58:54.088196 run osmo-msc_10.42.42.6(pid=4319): stderr: | 20221209005853197 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005853197 DLGLOBAL DEBUG validating counter group 0x7f6280903c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005853197 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005853197 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005853198 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005853198 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005853200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005853200 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005853200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005853200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:58:54.138917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4312): Terminating (SIGTERM) 00:58:54.179318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4315): Terminating (SIGTERM) 00:58:54.219680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4318): Terminating (SIGTERM) 00:58:54.260222 --- ParallelTerminationStrategy: PID 4312 died... 00:58:54.279447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4312): Terminated: ok {rc=0} 00:58:54.324791 --- ParallelTerminationStrategy: PID 4315 died... 00:58:54.343559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4315): Terminated: ok {rc=0} 00:58:54.388456 --- ParallelTerminationStrategy: PID 4318 died... 00:58:54.407295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4318): Terminated: ok {rc=0} 00:58:54.494866 bus /sierra_3: Setting Powered False 00:58:55.595437 bus /sierra_3: Setting Powered False 00:58:56.708736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_ussd:trx-b200 --------------------------------------------------------------------- 00:58:57.940392 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:57.944314 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 00:58:57.980144 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 00:58:57.987063 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 00:58:58.024144 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 00:58:58.059164 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 00:58:58.066095 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 00:58:58.582672 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2352 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 00:58:58.588083 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 00:58:58.599203 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 00:58:58.649813 tst assert_extension.py: using LAC 17962 00:58:58.776324 tst assert_extension.py: using RAC 112 00:58:58.902233 tst assert_extension.py: using CellId 17962 00:58:59.028344 tst assert_extension.py: using BVCI 17963 00:58:59.143790 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 00:58:59.258683 tst assert_extension.py:10: start nitb and bts... 00:58:59.459179 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:59:00.068657 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4325): Launched 00:59:00.368212 run osmo-nitb_10.42.42.2(pid=4326): Launched 00:59:00.533984 run osmo-nitb_10.42.42.2(pid=4326): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4326)] 00:59:00.667418 run osmo-nitb_10.42.42.2(pid=4326): stdout: | (launched: 2022-12-09_00:59:00.312205) 00:59:00.802711 run osmo-nitb_10.42.42.2(pid=4326): stderr: | (launched: 2022-12-09_00:59:00.356456) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:59:00.978697 run osmo-nitb_10.42.42.2(pid=4326): stdout: | (launched: 2022-12-09_00:59:00.312205) 00:59:01.123015 run osmo-nitb_10.42.42.2(pid=4326): stderr: | (launched: 2022-12-09_00:59:00.356456) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4326): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4326) [trial-2352↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4326)] 00:59:01.480680 tst osmo-nitb_10.42.42.2(pid=4326): stdout: | (launched: 2022-12-09_00:59:00.312205) 00:59:01.614021 tst osmo-nitb_10.42.42.2(pid=4326): stderr: | (launched: 2022-12-09_00:59:00.356456) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:59:01.772795 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4326): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4326) [trial-2352↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4326)] [trial-2352↪nitb_ussd:trx-b200↪assert_extension.py:12] 00:59:01.782539 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:59:01.790636 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4325): Terminating (SIGTERM) 00:59:02.003734 --- ParallelTerminationStrategy: PID 4325 died... 00:59:02.025119 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4325): Terminated: ok {rc=0} 00:59:02.115630 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 ussd:trx-b200 --------------------------------------------------------------------- 00:59:03.296577 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:59:03.300766 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 00:59:03.335264 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 00:59:03.362651 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 00:59:03.398811 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 00:59:03.432591 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 00:59:03.459766 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 00:59:03.987866 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2352 ussd:trx-b200 assert_extension.py ---------------------------------------------- 00:59:03.993477 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:59:04.004611 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 00:59:04.053896 tst assert_extension.py: using LAC 17963 00:59:04.178490 tst assert_extension.py: using RAC 113 00:59:04.304719 tst assert_extension.py: using CellId 17963 00:59:04.429621 tst assert_extension.py: using BVCI 17964 00:59:04.545036 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:59:04.555956 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:59:04.566875 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:59:04.577924 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:59:04.589229 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:59:04.600144 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 00:59:04.712693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:05.173385 run create_hlr_db(pid=4330): Launched 00:59:05.289136 bus /sierra_2: Setting Powered False 00:59:06.348718 run create_hlr_db(pid=4330): Terminated: ok {rc=0} 00:59:06.766015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4332): Launched 00:59:07.065042 run osmo-hlr_10.42.42.2(pid=4333): Launched 00:59:07.179909 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:07.711805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4335): Launched 00:59:08.010986 run osmo-stp_10.42.42.5(pid=4336): Launched 00:59:08.125201 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:08.661489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4338): Launched 00:59:08.960053 run osmo-msc_10.42.42.6(pid=4339): Launched 00:59:09.127200 run osmo-stp_10.42.42.5(pid=4336): ERR: Terminated: ERROR {rc=1} [trial-2352↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4336)] 00:59:09.253518 run osmo-stp_10.42.42.5(pid=4336): stdout: | (launched: 2022-12-09_00:59:07.954844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:09.379869 run osmo-stp_10.42.42.5(pid=4336): stderr: | 20221209005908126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005908126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005908127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005908127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005908128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005908128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005908128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:09.503708 run osmo-stp_10.42.42.5(pid=4336): stdout: | (launched: 2022-12-09_00:59:07.954844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:09.621897 run osmo-stp_10.42.42.5(pid=4336): stderr: | 20221209005908126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005908126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005908127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005908127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005908128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005908128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005908128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:09.763585 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4336): Process ended prematurely: osmo-stp_10.42.42.5(pid=4336) [trial-2352↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4336)] [trial-2352↪ussd:trx-b200↪assert_extension.py:17] 00:59:09.771924 tst assert_extension.py:17: Test FAILED (5.8 sec) 00:59:09.798456 run osmo-hlr_10.42.42.2(pid=4333): ERR: Terminated: ERROR {rc=237} [trial-2352↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4333)] 00:59:09.846517 run osmo-hlr_10.42.42.2(pid=4333): stdout: | (launched: 2022-12-09_00:59:07.009080) 00:59:09.896234 run osmo-hlr_10.42.42.2(pid=4333): stderr: | 20221209005907185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005907185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005907185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005907185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005907185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005907185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005907198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005907206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005907206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005907206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:09.965522 run osmo-msc_10.42.42.6(pid=4339): ERR: Terminated: ERROR {rc=2} [trial-2352↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4339)] 00:59:10.013392 run osmo-msc_10.42.42.6(pid=4339): stdout: | (launched: 2022-12-09_00:59:08.904473) 00:59:10.062783 run osmo-msc_10.42.42.6(pid=4339): stderr: | 20221209005909178 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005909178 DLGLOBAL DEBUG validating counter group 0x7ff6a68e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005909178 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005909179 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005909179 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005909179 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005909181 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005909181 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005909181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005909181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:10.112721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4332): Terminating (SIGTERM) 00:59:10.152673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4335): Terminating (SIGTERM) 00:59:10.192741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4338): Terminating (SIGTERM) 00:59:10.233084 --- ParallelTerminationStrategy: PID 4332 died... 00:59:10.252303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4332): Terminated: ok {rc=0} 00:59:10.296768 --- ParallelTerminationStrategy: PID 4335 died... 00:59:10.315344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4335): Terminated: ok {rc=0} 00:59:10.359817 --- ParallelTerminationStrategy: PID 4338 died... 00:59:10.378504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4338): Terminated: ok {rc=0} 00:59:10.463450 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:59:11.668599 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:59:11.675097 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:59:11.708592 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:59:11.735025 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:59:11.785698 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:59:11.819489 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:59:11.846824 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:59:12.394875 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:59:12.444476 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:12.455492 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:59:12.522908 tst mo_mt_call.py: using LAC 17964 00:59:12.640437 tst mo_mt_call.py: using RAC 114 00:59:12.758003 tst mo_mt_call.py: using CellId 17964 00:59:12.877172 tst mo_mt_call.py: using BVCI 17965 00:59:12.986188 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:12.997265 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:13.007996 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:13.019183 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:13.030481 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:13.041581 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:59:13.159384 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:59:13.280210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:13.785370 run create_hlr_db(pid=4344): Launched 00:59:13.917682 bus /sierra_2: Setting Powered False 00:59:14.981822 run create_hlr_db(pid=4344): Terminated: ok {rc=0} 00:59:15.416623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4346): Launched 00:59:15.720687 run osmo-hlr_10.42.42.2(pid=4347): Launched 00:59:15.891950 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:16.524448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4349): Launched 00:59:16.876386 run osmo-stp_10.42.42.5(pid=4350): Launched 00:59:17.146179 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:17.697374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4352): Launched 00:59:18.002311 run osmo-msc_10.42.42.6(pid=4353): Launched 00:59:18.171953 run osmo-stp_10.42.42.5(pid=4350): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4350)] 00:59:18.300317 run osmo-stp_10.42.42.5(pid=4350): stdout: | (launched: 2022-12-09_00:59:16.809484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:18.428611 run osmo-stp_10.42.42.5(pid=4350): stderr: | 20221209005916999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005916999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005916999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005916999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005917000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005917000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005917000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:18.555333 run osmo-stp_10.42.42.5(pid=4350): stdout: | (launched: 2022-12-09_00:59:16.809484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:18.675683 run osmo-stp_10.42.42.5(pid=4350): stderr: | 20221209005916999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005916999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005916999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005916999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005917000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005917000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005917000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:18.819965 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4350): Process ended prematurely: osmo-stp_10.42.42.5(pid=4350) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4350)] [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:59:18.829181 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:59:18.856265 run osmo-hlr_10.42.42.2(pid=4347): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4347)] 00:59:18.904875 run osmo-hlr_10.42.42.2(pid=4347): stdout: | (launched: 2022-12-09_00:59:15.664079) 00:59:18.954967 run osmo-hlr_10.42.42.2(pid=4347): stderr: | 20221209005915843 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005915843 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005915843 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005915843 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005915843 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005915843 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005915863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005915871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005915871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005915871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:19.024641 run osmo-msc_10.42.42.6(pid=4353): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4353)] 00:59:19.072843 run osmo-msc_10.42.42.6(pid=4353): stdout: | (launched: 2022-12-09_00:59:17.945607) 00:59:19.122736 run osmo-msc_10.42.42.6(pid=4353): stderr: | 20221209005918219 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005918219 DLGLOBAL DEBUG validating counter group 0x7f6594858c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005918219 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005918219 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005918220 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005918220 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005918222 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005918222 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005918222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005918222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:19.173033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4346): Terminating (SIGTERM) 00:59:19.213040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4349): Terminating (SIGTERM) 00:59:19.253026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4352): Terminating (SIGTERM) 00:59:19.293132 --- ParallelTerminationStrategy: PID 4346 died... 00:59:19.312236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4346): Terminated: ok {rc=0} 00:59:19.357057 --- ParallelTerminationStrategy: PID 4349 died... 00:59:19.375657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4349): Terminated: ok {rc=0} 00:59:19.419805 --- ParallelTerminationStrategy: PID 4352 died... 00:59:19.438436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4352): Terminated: ok {rc=0} 00:59:19.526878 bus /sierra_3: Setting Powered False 00:59:20.627373 bus /sierra_3: Setting Powered False 00:59:21.745902 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:59:22.896014 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:22.908331 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:59:22.980043 tst mo_mt_call_osmux.py: using LAC 17965 00:59:23.109768 tst mo_mt_call_osmux.py: using RAC 115 00:59:23.238466 tst mo_mt_call_osmux.py: using CellId 17965 00:59:23.366529 tst mo_mt_call_osmux.py: using BVCI 17966 00:59:23.486189 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:23.497782 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:23.509135 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:23.520587 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:23.532804 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:23.544523 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:59:23.663713 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:59:23.780015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:24.249972 run create_hlr_db(pid=4355): Launched 00:59:24.367291 bus /sierra_2: Setting Powered False 00:59:25.427343 run create_hlr_db(pid=4355): Terminated: ok {rc=0} 00:59:25.873137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4357): Launched 00:59:26.199049 run osmo-hlr_10.42.42.2(pid=4358): Launched 00:59:26.323053 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:26.885528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4360): Launched 00:59:27.213655 run osmo-stp_10.42.42.5(pid=4361): Launched 00:59:27.339764 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:27.932787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4363): Launched 00:59:28.259180 run osmo-msc_10.42.42.6(pid=4364): Launched 00:59:28.441991 run osmo-stp_10.42.42.5(pid=4361): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4361)] 00:59:28.577751 run osmo-stp_10.42.42.5(pid=4361): stdout: | (launched: 2022-12-09_00:59:27.153723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:28.714672 run osmo-stp_10.42.42.5(pid=4361): stderr: | 20221209005927347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005927347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005927348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005927348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005927349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005927349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005927349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:28.851358 run osmo-stp_10.42.42.5(pid=4361): stdout: | (launched: 2022-12-09_00:59:27.153723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:28.980734 run osmo-stp_10.42.42.5(pid=4361): stderr: | 20221209005927347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005927347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005927348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005927348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005927349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005927349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005927349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:29.136013 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4361): Process ended prematurely: osmo-stp_10.42.42.5(pid=4361) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4361)] [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:59:29.146079 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:59:29.174478 run osmo-hlr_10.42.42.2(pid=4358): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4358)] 00:59:29.225127 run osmo-hlr_10.42.42.2(pid=4358): stdout: | (launched: 2022-12-09_00:59:26.139161) 00:59:29.277574 run osmo-hlr_10.42.42.2(pid=4358): stderr: | 20221209005926340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005926340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005926340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005926340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005926340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005926340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005926352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005926361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005926361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005926361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:29.350370 run osmo-msc_10.42.42.6(pid=4364): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4364)] 00:59:29.401271 run osmo-msc_10.42.42.6(pid=4364): stdout: | (launched: 2022-12-09_00:59:28.199248) 00:59:29.453297 run osmo-msc_10.42.42.6(pid=4364): stderr: | 20221209005928523 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005928523 DLGLOBAL DEBUG validating counter group 0x7f3f4df16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005928523 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005928523 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005928523 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005928523 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005928526 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005928526 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005928526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005928526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:29.505467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4357): Terminating (SIGTERM) 00:59:29.547270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4360): Terminating (SIGTERM) 00:59:29.589272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4363): Terminating (SIGTERM) 00:59:29.631540 --- ParallelTerminationStrategy: PID 4357 died... 00:59:29.651831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4357): Terminated: ok {rc=0} 00:59:29.698708 --- ParallelTerminationStrategy: PID 4360 died... 00:59:29.718875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4360): Terminated: ok {rc=0} 00:59:29.765672 --- ParallelTerminationStrategy: PID 4363 died... 00:59:29.785357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4363): Terminated: ok {rc=0} 00:59:29.874925 bus /sierra_3: Setting Powered False 00:59:30.973208 bus /sierra_3: Setting Powered False 00:59:32.088720 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:59:33.336231 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:59:33.342575 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:59:33.375485 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:59:33.401610 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:59:33.454596 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:59:33.489990 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:59:33.518026 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:59:34.064676 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:59:34.115684 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:34.126756 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:59:34.195375 tst mo_mt_call.py: using LAC 17966 00:59:34.315242 tst mo_mt_call.py: using RAC 116 00:59:34.447737 tst mo_mt_call.py: using CellId 17966 00:59:34.579524 tst mo_mt_call.py: using BVCI 17967 00:59:34.699160 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:34.711166 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:34.722779 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:34.734323 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:34.745747 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:34.757103 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:34.875588 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:34.991739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:35.463621 run create_hlr_db(pid=4369): Launched 00:59:35.581713 bus /sierra_2: Setting Powered False 00:59:36.642629 run create_hlr_db(pid=4369): Terminated: ok {rc=0} 00:59:37.067415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4371): Launched 00:59:37.372449 run osmo-hlr_10.42.42.2(pid=4372): Launched 00:59:37.489107 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:38.027791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4374): Launched 00:59:38.333162 run osmo-stp_10.42.42.5(pid=4375): Launched 00:59:38.449795 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:38.999118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4377): Launched 00:59:39.303474 run osmo-msc_10.42.42.6(pid=4378): Launched 00:59:39.474355 run osmo-stp_10.42.42.5(pid=4375): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4375)] 00:59:39.603400 run osmo-stp_10.42.42.5(pid=4375): stdout: | (launched: 2022-12-09_00:59:38.276917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:39.732074 run osmo-stp_10.42.42.5(pid=4375): stderr: | 20221209005938450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005938450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005938450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005938451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005938451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005938451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005938451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:39.858900 run osmo-stp_10.42.42.5(pid=4375): stdout: | (launched: 2022-12-09_00:59:38.276917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:39.979567 run osmo-stp_10.42.42.5(pid=4375): stderr: | 20221209005938450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005938450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005938450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005938451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005938451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005938451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005938451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:40.123915 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4375): Process ended prematurely: osmo-stp_10.42.42.5(pid=4375) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4375)] [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:59:40.133017 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:59:40.159925 run osmo-hlr_10.42.42.2(pid=4372): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4372)] 00:59:40.208125 run osmo-hlr_10.42.42.2(pid=4372): stdout: | (launched: 2022-12-09_00:59:37.316144) 00:59:40.258109 run osmo-hlr_10.42.42.2(pid=4372): stderr: | 20221209005937496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005937496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005937496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005937496 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005937496 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005937496 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005937513 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005937522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005937523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005937523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:40.327497 run osmo-msc_10.42.42.6(pid=4378): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4378)] 00:59:40.376268 run osmo-msc_10.42.42.6(pid=4378): stdout: | (launched: 2022-12-09_00:59:39.247262) 00:59:40.426211 run osmo-msc_10.42.42.6(pid=4378): stderr: | 20221209005939520 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005939520 DLGLOBAL DEBUG validating counter group 0x7fe97bb72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005939520 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005939520 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005939521 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005939521 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005939523 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005939523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005939524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005939524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:40.476249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4371): Terminating (SIGTERM) 00:59:40.516401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4374): Terminating (SIGTERM) 00:59:40.556230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4377): Terminating (SIGTERM) 00:59:40.596724 --- ParallelTerminationStrategy: PID 4371 died... 00:59:40.615934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4371): Terminated: ok {rc=0} 00:59:40.660807 --- ParallelTerminationStrategy: PID 4374 died... 00:59:40.679565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4374): Terminated: ok {rc=0} 00:59:40.724235 --- ParallelTerminationStrategy: PID 4377 died... 00:59:40.742852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4377): Terminated: ok {rc=0} 00:59:40.829562 bus /sierra_3: Setting Powered False 00:59:41.929677 bus /sierra_3: Setting Powered False 00:59:43.047791 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:59:44.196061 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:44.208041 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:59:44.277963 tst mo_mt_call_osmux.py: using LAC 17967 00:59:44.398559 tst mo_mt_call_osmux.py: using RAC 117 00:59:44.519996 tst mo_mt_call_osmux.py: using CellId 17967 00:59:44.644245 tst mo_mt_call_osmux.py: using BVCI 17968 00:59:44.756283 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:44.767316 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:44.778150 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:44.789295 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:44.800391 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:44.811489 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:44.930215 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:45.046727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:45.518458 run create_hlr_db(pid=4380): Launched 00:59:45.636624 bus /sierra_2: Setting Powered False 00:59:46.701628 run create_hlr_db(pid=4380): Terminated: ok {rc=0} 00:59:47.169166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4382): Launched 00:59:47.496814 run osmo-hlr_10.42.42.2(pid=4383): Launched 00:59:47.622722 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:48.185546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4385): Launched 00:59:48.512658 run osmo-stp_10.42.42.5(pid=4386): Launched 00:59:48.637610 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:49.232044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4388): Launched 00:59:49.560731 run osmo-msc_10.42.42.6(pid=4389): Launched 00:59:49.743579 run osmo-stp_10.42.42.5(pid=4386): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4386)] 00:59:49.882947 run osmo-stp_10.42.42.5(pid=4386): stdout: | (launched: 2022-12-09_00:59:48.452364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:50.020298 run osmo-stp_10.42.42.5(pid=4386): stderr: | 20221209005948645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005948646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005948646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005948646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005948647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005948647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005948647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:50.156930 run osmo-stp_10.42.42.5(pid=4386): stdout: | (launched: 2022-12-09_00:59:48.452364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:50.286259 run osmo-stp_10.42.42.5(pid=4386): stderr: | 20221209005948645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005948646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005948646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005948646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005948647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005948647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005948647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:50.441344 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4386): Process ended prematurely: osmo-stp_10.42.42.5(pid=4386) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4386)] [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:59:50.450777 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:59:50.478699 run osmo-hlr_10.42.42.2(pid=4383): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4383)] 00:59:50.529152 run osmo-hlr_10.42.42.2(pid=4383): stdout: | (launched: 2022-12-09_00:59:47.437204) 00:59:50.581547 run osmo-hlr_10.42.42.2(pid=4383): stderr: | 20221209005947638 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005947638 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005947638 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005947638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005947638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005947638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005947652 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005947662 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005947662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005947662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:50.653861 run osmo-msc_10.42.42.6(pid=4389): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4389)] 00:59:50.704024 run osmo-msc_10.42.42.6(pid=4389): stdout: | (launched: 2022-12-09_00:59:49.500672) 00:59:50.756055 run osmo-msc_10.42.42.6(pid=4389): stderr: | 20221209005949823 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209005949824 DLGLOBAL DEBUG validating counter group 0x7f11f0f04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209005949824 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209005949824 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209005949824 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209005949824 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209005949826 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209005949826 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209005949826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209005949826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:50.808282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4382): Terminating (SIGTERM) 00:59:50.849936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4385): Terminating (SIGTERM) 00:59:50.891636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4388): Terminating (SIGTERM) 00:59:50.933535 --- ParallelTerminationStrategy: PID 4382 died... 00:59:50.953543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4382): Terminated: ok {rc=0} 00:59:50.999739 --- ParallelTerminationStrategy: PID 4385 died... 00:59:51.019238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4385): Terminated: ok {rc=0} 00:59:51.065142 --- ParallelTerminationStrategy: PID 4388 died... 00:59:51.084559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4388): Terminated: ok {rc=0} 00:59:51.172589 bus /sierra_3: Setting Powered False 00:59:52.271118 bus /sierra_3: Setting Powered False 00:59:53.386383 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:59:54.636634 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:59:54.643119 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:59:54.676575 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:59:54.702951 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:59:54.756025 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:59:54.788834 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:59:54.815106 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:59:55.363369 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:59:55.412078 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:55.423126 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:59:55.491906 tst mo_mt_call.py: using LAC 17968 00:59:55.614432 tst mo_mt_call.py: using RAC 118 00:59:55.734145 tst mo_mt_call.py: using CellId 17968 00:59:55.861525 tst mo_mt_call.py: using BVCI 17969 00:59:55.979563 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:55.991396 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:56.002771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:56.014236 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:56.025716 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:56.037182 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:59:56.153708 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:59:56.273649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:56.778327 run create_hlr_db(pid=4394): Launched 00:59:56.909659 bus /sierra_2: Setting Powered False 00:59:57.973723 run create_hlr_db(pid=4394): Terminated: ok {rc=0} 00:59:58.426919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4396): Launched 00:59:58.752358 run osmo-hlr_10.42.42.2(pid=4397): Launched 00:59:58.876051 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:59.440036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4399): Launched 00:59:59.766657 run osmo-stp_10.42.42.5(pid=4400): Launched 00:59:59.891975 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:00.480342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4402): Launched 01:00:00.807278 run osmo-msc_10.42.42.6(pid=4403): Launched 01:00:01.108571 run osmo-stp_10.42.42.5(pid=4400): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4400)] 01:00:01.394425 run osmo-stp_10.42.42.5(pid=4400): stdout: | (launched: 2022-12-09_00:59:59.706429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:01.638636 run osmo-stp_10.42.42.5(pid=4400): stderr: | 20221209005959899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005959899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005959900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005959900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005959900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005959901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005959901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:01.777388 run osmo-stp_10.42.42.5(pid=4400): stdout: | (launched: 2022-12-09_00:59:59.706429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:01.908412 run osmo-stp_10.42.42.5(pid=4400): stderr: | 20221209005959899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209005959899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209005959900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209005959900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209005959900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209005959901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209005959901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:02.064880 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4400): Process ended prematurely: osmo-stp_10.42.42.5(pid=4400) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4400)] [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:00:02.075024 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 01:00:02.103770 run osmo-hlr_10.42.42.2(pid=4397): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4397)] 01:00:02.155374 run osmo-hlr_10.42.42.2(pid=4397): stdout: | (launched: 2022-12-09_00:59:58.691995) 01:00:02.208335 run osmo-hlr_10.42.42.2(pid=4397): stderr: | 20221209005958891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209005958891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209005958891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209005958891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209005958891 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209005958891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209005958904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209005958912 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209005958912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209005958912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:02.281643 run osmo-msc_10.42.42.6(pid=4403): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4403)] 01:00:02.331950 run osmo-msc_10.42.42.6(pid=4403): stdout: | (launched: 2022-12-09_01:00:00.746918) 01:00:02.383853 run osmo-msc_10.42.42.6(pid=4403): stderr: | 20221209010001330 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010001330 DLGLOBAL DEBUG validating counter group 0x7f32637f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010001331 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010001331 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010001331 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010001331 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010001333 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010001333 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010001333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010001333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:02.436318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4396): Terminating (SIGTERM) 01:00:02.478350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4399): Terminating (SIGTERM) 01:00:02.520276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4402): Terminating (SIGTERM) 01:00:02.562452 --- ParallelTerminationStrategy: PID 4396 died... 01:00:02.582637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4396): Terminated: ok {rc=0} 01:00:02.629248 --- ParallelTerminationStrategy: PID 4399 died... 01:00:02.648700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4399): Terminated: ok {rc=0} 01:00:02.695635 --- ParallelTerminationStrategy: PID 4402 died... 01:00:02.715521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4402): Terminated: ok {rc=0} 01:00:02.804881 bus /sierra_3: Setting Powered False 01:00:03.904942 bus /sierra_3: Setting Powered False 01:00:05.021811 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:00:06.172382 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:00:06.184653 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:00:06.256427 tst mo_mt_call_osmux.py: using LAC 17969 01:00:06.389413 tst mo_mt_call_osmux.py: using RAC 119 01:00:06.516017 tst mo_mt_call_osmux.py: using CellId 17969 01:00:06.635823 tst mo_mt_call_osmux.py: using BVCI 17970 01:00:06.747629 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:00:06.758713 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:00:06.769646 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:00:06.780658 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:00:06.791851 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:00:06.802876 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:00:06.918880 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:00:07.039305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:07.542953 run create_hlr_db(pid=4408): Launched 01:00:07.675335 bus /sierra_2: Setting Powered False 01:00:08.739948 run create_hlr_db(pid=4408): Terminated: ok {rc=0} 01:00:09.173772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4410): Launched 01:00:09.478398 run osmo-hlr_10.42.42.2(pid=4411): Launched 01:00:09.594071 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:10.127411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4413): Launched 01:00:10.432462 run osmo-stp_10.42.42.5(pid=4414): Launched 01:00:10.548929 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:11.099760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4416): Launched 01:00:11.405665 run osmo-msc_10.42.42.6(pid=4417): Launched 01:00:11.576436 run osmo-stp_10.42.42.5(pid=4414): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4414)] 01:00:11.705866 run osmo-stp_10.42.42.5(pid=4414): stdout: | (launched: 2022-12-09_01:00:10.375905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:11.835917 run osmo-stp_10.42.42.5(pid=4414): stderr: | 20221209010010547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010010547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010010547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010010548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010010550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010010550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010010550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:11.963199 run osmo-stp_10.42.42.5(pid=4414): stdout: | (launched: 2022-12-09_01:00:10.375905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:12.084028 run osmo-stp_10.42.42.5(pid=4414): stderr: | 20221209010010547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010010547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010010547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010010548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010010550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010010550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010010550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:12.229659 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4414): Process ended prematurely: osmo-stp_10.42.42.5(pid=4414) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4414)] [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:00:12.238563 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:00:12.265287 run osmo-hlr_10.42.42.2(pid=4411): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4411)] 01:00:12.313801 run osmo-hlr_10.42.42.2(pid=4411): stdout: | (launched: 2022-12-09_01:00:09.422130) 01:00:12.363771 run osmo-hlr_10.42.42.2(pid=4411): stderr: | 20221209010009599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010009599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010009599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010009600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010009600 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010009600 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010009612 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010009620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010009620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010009620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:12.432892 run osmo-msc_10.42.42.6(pid=4417): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4417)] 01:00:12.482339 run osmo-msc_10.42.42.6(pid=4417): stdout: | (launched: 2022-12-09_01:00:11.349097) 01:00:12.531953 run osmo-msc_10.42.42.6(pid=4417): stderr: | 20221209010011624 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010011624 DLGLOBAL DEBUG validating counter group 0x7fa5c226bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010011624 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010011624 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010011624 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010011625 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010011628 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010011629 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010011629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010011629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:12.581907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4410): Terminating (SIGTERM) 01:00:12.621833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4413): Terminating (SIGTERM) 01:00:12.661831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4416): Terminating (SIGTERM) 01:00:12.702017 --- ParallelTerminationStrategy: PID 4410 died... 01:00:12.720911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4410): Terminated: ok {rc=0} 01:00:12.765448 --- ParallelTerminationStrategy: PID 4413 died... 01:00:12.783949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4413): Terminated: ok {rc=0} 01:00:12.828306 --- ParallelTerminationStrategy: PID 4416 died... 01:00:12.846804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4416): Terminated: ok {rc=0} 01:00:12.932278 bus /sierra_3: Setting Powered False 01:00:14.032386 bus /sierra_3: Setting Powered False 01:00:15.148252 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:00:16.428011 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:00:16.436536 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:00:16.472881 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:00:16.502116 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:00:16.558248 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:00:16.599117 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:00:16.633567 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:00:17.173208 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:00:17.227244 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:17.239500 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:00:17.312268 tst mo_mt_call.py: using LAC 17970 01:00:17.445432 tst mo_mt_call.py: using RAC 120 01:00:17.573347 tst mo_mt_call.py: using CellId 17970 01:00:17.701362 tst mo_mt_call.py: using BVCI 17971 01:00:17.821774 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:17.833593 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:17.844924 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:17.856884 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:17.869171 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:17.881608 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:00:17.998012 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:00:18.118052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:18.623309 run create_hlr_db(pid=4422): Launched 01:00:18.758243 bus /sierra_2: Setting Powered False 01:00:19.823891 run create_hlr_db(pid=4422): Terminated: ok {rc=0} 01:00:20.278377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4424): Launched 01:00:20.606321 run osmo-hlr_10.42.42.2(pid=4425): Launched 01:00:20.732752 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:21.296906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4427): Launched 01:00:21.623727 run osmo-stp_10.42.42.5(pid=4428): Launched 01:00:21.748119 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:22.344143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4430): Launched 01:00:22.672318 run osmo-msc_10.42.42.6(pid=4431): Launched 01:00:22.855195 run osmo-stp_10.42.42.5(pid=4428): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4428)] 01:00:22.996749 run osmo-stp_10.42.42.5(pid=4428): stdout: | (launched: 2022-12-09_01:00:21.563481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:23.134301 run osmo-stp_10.42.42.5(pid=4428): stderr: | 20221209010021757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010021757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010021758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010021758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010021759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010021759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010021759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:23.269900 run osmo-stp_10.42.42.5(pid=4428): stdout: | (launched: 2022-12-09_01:00:21.563481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:23.400014 run osmo-stp_10.42.42.5(pid=4428): stderr: | 20221209010021757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010021757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010021758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010021758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010021759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010021759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010021759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:23.555616 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4428): Process ended prematurely: osmo-stp_10.42.42.5(pid=4428) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4428)] [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:00:23.565336 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:00:23.593517 run osmo-hlr_10.42.42.2(pid=4425): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4425)] 01:00:23.644266 run osmo-hlr_10.42.42.2(pid=4425): stdout: | (launched: 2022-12-09_01:00:20.546347) 01:00:23.696658 run osmo-hlr_10.42.42.2(pid=4425): stderr: | 20221209010020747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010020747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010020747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010020747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010020747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010020747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010020759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010020768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010020768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010020768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:23.769500 run osmo-msc_10.42.42.6(pid=4431): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4431)] 01:00:23.820294 run osmo-msc_10.42.42.6(pid=4431): stdout: | (launched: 2022-12-09_01:00:22.611868) 01:00:23.872823 run osmo-msc_10.42.42.6(pid=4431): stderr: | 20221209010022938 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010022938 DLGLOBAL DEBUG validating counter group 0x7fa79df4dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010022939 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010022939 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010022939 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010022939 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010022941 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010022941 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010022941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010022941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:23.925322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4424): Terminating (SIGTERM) 01:00:23.967170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4427): Terminating (SIGTERM) 01:00:24.009268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4430): Terminating (SIGTERM) 01:00:24.051693 --- ParallelTerminationStrategy: PID 4424 died... 01:00:24.071919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4424): Terminated: ok {rc=0} 01:00:24.118768 --- ParallelTerminationStrategy: PID 4427 died... 01:00:24.138761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4427): Terminated: ok {rc=0} 01:00:24.185440 --- ParallelTerminationStrategy: PID 4430 died... 01:00:24.205148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4430): Terminated: ok {rc=0} 01:00:24.293997 bus /sierra_3: Setting Powered False 01:00:25.393984 bus /sierra_3: Setting Powered False 01:00:26.510451 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:00:27.660866 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:27.673263 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:00:27.745444 tst mo_mt_call_osmux.py: using LAC 17971 01:00:27.873946 tst mo_mt_call_osmux.py: using RAC 121 01:00:28.001582 tst mo_mt_call_osmux.py: using CellId 17971 01:00:28.129047 tst mo_mt_call_osmux.py: using BVCI 17972 01:00:28.247494 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:28.259007 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:28.270363 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:28.281680 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:28.293080 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:28.304450 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:00:28.424337 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:00:28.540019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:29.010397 run create_hlr_db(pid=4433): Launched 01:00:29.126090 bus /sierra_2: Setting Powered False 01:00:30.186496 run create_hlr_db(pid=4433): Terminated: ok {rc=0} 01:00:30.630831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4435): Launched 01:00:30.977719 run osmo-hlr_10.42.42.2(pid=4436): Launched 01:00:31.244578 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:31.869322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4438): Launched 01:00:32.242661 run osmo-stp_10.42.42.5(pid=4439): Launched 01:00:32.367453 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:32.959269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4441): Launched 01:00:33.285244 run osmo-msc_10.42.42.6(pid=4442): Launched 01:00:33.468140 run osmo-stp_10.42.42.5(pid=4439): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4439)] 01:00:33.604440 run osmo-stp_10.42.42.5(pid=4439): stdout: | (launched: 2022-12-09_01:00:32.182993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:33.741706 run osmo-stp_10.42.42.5(pid=4439): stderr: | 20221209010032384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010032385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010032385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010032385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010032386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010032386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010032386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:33.878358 run osmo-stp_10.42.42.5(pid=4439): stdout: | (launched: 2022-12-09_01:00:32.182993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:34.008309 run osmo-stp_10.42.42.5(pid=4439): stderr: | 20221209010032384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010032385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010032385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010032385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010032386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010032386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010032386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:34.163033 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4439): Process ended prematurely: osmo-stp_10.42.42.5(pid=4439) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4439)] [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:00:34.172684 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 01:00:34.200817 run osmo-hlr_10.42.42.2(pid=4436): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4436)] 01:00:34.251307 run osmo-hlr_10.42.42.2(pid=4436): stdout: | (launched: 2022-12-09_01:00:30.913681) 01:00:34.303575 run osmo-hlr_10.42.42.2(pid=4436): stderr: | 20221209010031150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010031150 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010031151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010031151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010031151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010031151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010031167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010031183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010031184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010031184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:34.376197 run osmo-msc_10.42.42.6(pid=4442): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4442)] 01:00:34.426481 run osmo-msc_10.42.42.6(pid=4442): stdout: | (launched: 2022-12-09_01:00:33.225413) 01:00:34.478574 run osmo-msc_10.42.42.6(pid=4442): stderr: | 20221209010033550 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010033551 DLGLOBAL DEBUG validating counter group 0x7fc808807c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010033551 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010033551 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010033551 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010033551 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010033553 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010033553 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010033554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010033554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:34.530776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4435): Terminating (SIGTERM) 01:00:34.572712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4438): Terminating (SIGTERM) 01:00:34.614986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4441): Terminating (SIGTERM) 01:00:34.657233 --- ParallelTerminationStrategy: PID 4435 died... 01:00:34.677402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4435): Terminated: ok {rc=0} 01:00:34.724178 --- ParallelTerminationStrategy: PID 4438 died... 01:00:34.744250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4438): Terminated: ok {rc=0} 01:00:34.791116 --- ParallelTerminationStrategy: PID 4441 died... 01:00:34.810978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4441): Terminated: ok {rc=0} 01:00:34.898560 bus /sierra_3: Setting Powered False 01:00:35.998863 bus /sierra_3: Setting Powered False 01:00:37.118273 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:00:38.370603 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:00:38.377551 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:00:38.411728 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:00:38.439009 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:00:38.490671 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:00:38.524434 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:00:38.551742 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:00:39.104847 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:00:39.157480 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.168852 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:00:39.238194 tst mo_mt_call.py: using LAC 17972 01:00:39.365272 tst mo_mt_call.py: using RAC 122 01:00:39.490536 tst mo_mt_call.py: using CellId 17972 01:00:39.616104 tst mo_mt_call.py: using BVCI 17973 01:00:39.734075 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.745984 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.757437 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.768739 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.780164 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.791483 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:39.907975 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:40.023986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:40.495806 run create_hlr_db(pid=4447): Launched 01:00:40.615130 bus /sierra_2: Setting Powered False 01:00:41.676106 run create_hlr_db(pid=4447): Terminated: ok {rc=0} 01:00:42.099676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4449): Launched 01:00:42.403243 run osmo-hlr_10.42.42.2(pid=4450): Launched 01:00:42.518938 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:43.057266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4452): Launched 01:00:43.362258 run osmo-stp_10.42.42.5(pid=4453): Launched 01:00:43.478421 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:44.029422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4455): Launched 01:00:44.335435 run osmo-msc_10.42.42.6(pid=4456): Launched 01:00:44.506961 run osmo-stp_10.42.42.5(pid=4453): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4453)] 01:00:44.636141 run osmo-stp_10.42.42.5(pid=4453): stdout: | (launched: 2022-12-09_01:00:43.305849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:44.765614 run osmo-stp_10.42.42.5(pid=4453): stderr: | 20221209010043476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010043477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010043477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010043477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010043478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010043478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010043478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:44.892435 run osmo-stp_10.42.42.5(pid=4453): stdout: | (launched: 2022-12-09_01:00:43.305849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:45.012838 run osmo-stp_10.42.42.5(pid=4453): stderr: | 20221209010043476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010043477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010043477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010043477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010043478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010043478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010043478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:45.157376 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4453): Process ended prematurely: osmo-stp_10.42.42.5(pid=4453) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4453)] [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:00:45.166418 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:00:45.193670 run osmo-hlr_10.42.42.2(pid=4450): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4450)] 01:00:45.242077 run osmo-hlr_10.42.42.2(pid=4450): stdout: | (launched: 2022-12-09_01:00:42.346754) 01:00:45.292245 run osmo-hlr_10.42.42.2(pid=4450): stderr: | 20221209010042523 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010042523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010042523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010042523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010042523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010042523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010042535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010042544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010042544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010042544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:45.362207 run osmo-msc_10.42.42.6(pid=4456): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4456)] 01:00:45.410571 run osmo-msc_10.42.42.6(pid=4456): stdout: | (launched: 2022-12-09_01:00:44.278928) 01:00:45.460400 run osmo-msc_10.42.42.6(pid=4456): stderr: | 20221209010044552 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010044552 DLGLOBAL DEBUG validating counter group 0x7fd5826bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010044552 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010044552 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010044552 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010044552 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010044554 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010044555 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010044555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010044555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:45.510797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4449): Terminating (SIGTERM) 01:00:45.550795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4452): Terminating (SIGTERM) 01:00:45.590868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4455): Terminating (SIGTERM) 01:00:45.631318 --- ParallelTerminationStrategy: PID 4449 died... 01:00:45.650643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4449): Terminated: ok {rc=0} 01:00:45.695452 --- ParallelTerminationStrategy: PID 4452 died... 01:00:45.714148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4452): Terminated: ok {rc=0} 01:00:45.759488 --- ParallelTerminationStrategy: PID 4455 died... 01:00:45.778304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4455): Terminated: ok {rc=0} 01:00:45.882169 bus /sierra_3: Setting Powered False 01:00:46.983514 bus /sierra_3: Setting Powered False 01:00:48.103219 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:00:49.251451 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:49.263290 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:00:49.337442 tst mo_mt_call_osmux.py: using LAC 17973 01:00:49.460128 tst mo_mt_call_osmux.py: using RAC 123 01:00:49.578823 tst mo_mt_call_osmux.py: using CellId 17973 01:00:49.697445 tst mo_mt_call_osmux.py: using BVCI 17974 01:00:49.816572 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:49.828174 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:49.839524 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:49.850992 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:49.862492 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:49.873908 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:49.990099 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:50.110670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:50.617197 run create_hlr_db(pid=4458): Launched 01:00:50.749332 bus /sierra_2: Setting Powered False 01:00:51.813572 run create_hlr_db(pid=4458): Terminated: ok {rc=0} 01:00:52.268596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4460): Launched 01:00:52.595450 run osmo-hlr_10.42.42.2(pid=4461): Launched 01:00:52.721890 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:53.288933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4463): Launched 01:00:53.617199 run osmo-stp_10.42.42.5(pid=4464): Launched 01:00:53.743322 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:54.336703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4466): Launched 01:00:54.664740 run osmo-msc_10.42.42.6(pid=4467): Launched 01:00:54.848751 run osmo-stp_10.42.42.5(pid=4464): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4464)] 01:00:54.986359 run osmo-stp_10.42.42.5(pid=4464): stdout: | (launched: 2022-12-09_01:00:53.557027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:55.123369 run osmo-stp_10.42.42.5(pid=4464): stderr: | 20221209010053751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010053751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010053752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010053752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010053754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010053755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010053755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:55.259371 run osmo-stp_10.42.42.5(pid=4464): stdout: | (launched: 2022-12-09_01:00:53.557027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:55.389449 run osmo-stp_10.42.42.5(pid=4464): stderr: | 20221209010053751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010053751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010053752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010053752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010053754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010053755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010053755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:55.545013 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4464): Process ended prematurely: osmo-stp_10.42.42.5(pid=4464) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4464)] [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:00:55.554637 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:00:55.582718 run osmo-hlr_10.42.42.2(pid=4461): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4461)] 01:00:55.633213 run osmo-hlr_10.42.42.2(pid=4461): stdout: | (launched: 2022-12-09_01:00:52.535592) 01:00:55.685551 run osmo-hlr_10.42.42.2(pid=4461): stderr: | 20221209010052737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010052737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010052737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010052737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010052738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010052738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010052750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010052758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010052758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010052758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:55.758618 run osmo-msc_10.42.42.6(pid=4467): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4467)] 01:00:55.809431 run osmo-msc_10.42.42.6(pid=4467): stdout: | (launched: 2022-12-09_01:00:54.604202) 01:00:55.861669 run osmo-msc_10.42.42.6(pid=4467): stderr: | 20221209010054930 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010054930 DLGLOBAL DEBUG validating counter group 0x7f164a17dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010054930 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010054930 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010054930 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010054931 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010054932 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010054933 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010054933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010054933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:55.914234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4460): Terminating (SIGTERM) 01:00:55.956414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4463): Terminating (SIGTERM) 01:00:55.998741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4466): Terminating (SIGTERM) 01:00:56.041240 --- ParallelTerminationStrategy: PID 4460 died... 01:00:56.061423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4460): Terminated: ok {rc=0} 01:00:56.108587 --- ParallelTerminationStrategy: PID 4463 died... 01:00:56.128260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4463): Terminated: ok {rc=0} 01:00:56.174882 --- ParallelTerminationStrategy: PID 4466 died... 01:00:56.194595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4466): Terminated: ok {rc=0} 01:00:56.283076 bus /sierra_3: Setting Powered False 01:00:57.383423 bus /sierra_3: Setting Powered False 01:00:58.500581 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:00:59.745730 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:00:59.754053 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:00:59.788516 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:00:59.816405 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:00:59.871073 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:00:59.905110 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:00:59.932175 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:01:00.487210 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:01:00.538216 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:00.549703 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:01:00.618820 tst mo_mt_call.py: using LAC 17974 01:01:00.741356 tst mo_mt_call.py: using RAC 124 01:01:00.894466 tst mo_mt_call.py: using CellId 17974 01:01:01.026328 tst mo_mt_call.py: using BVCI 17975 01:01:01.180827 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:01.196601 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:01.213268 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:01.230360 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:01.246570 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:01.262508 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:01:01.408560 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:01:01.551014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:02.095125 run create_hlr_db(pid=4473): Launched 01:01:02.260685 bus /sierra_2: Setting Powered False 01:01:03.325614 run create_hlr_db(pid=4473): Terminated: ok {rc=0} 01:01:03.761983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4475): Launched 01:01:04.066813 run osmo-hlr_10.42.42.2(pid=4476): Launched 01:01:04.183791 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:04.721695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4478): Launched 01:01:05.027854 run osmo-stp_10.42.42.5(pid=4479): Launched 01:01:05.144394 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:05.693491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4481): Launched 01:01:05.998838 run osmo-msc_10.42.42.6(pid=4482): Launched 01:01:06.169221 run osmo-stp_10.42.42.5(pid=4479): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4479)] 01:01:06.297527 run osmo-stp_10.42.42.5(pid=4479): stdout: | (launched: 2022-12-09_01:01:04.971204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:06.426307 run osmo-stp_10.42.42.5(pid=4479): stderr: | 20221209010105142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010105142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010105143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010105143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010105145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010105145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010105146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:06.552551 run osmo-stp_10.42.42.5(pid=4479): stdout: | (launched: 2022-12-09_01:01:04.971204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:06.673509 run osmo-stp_10.42.42.5(pid=4479): stderr: | 20221209010105142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010105142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010105143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010105143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010105145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010105145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010105146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:06.818008 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4479): Process ended prematurely: osmo-stp_10.42.42.5(pid=4479) [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4479)] [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:01:06.826936 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:01:06.853931 run osmo-hlr_10.42.42.2(pid=4476): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4476)] 01:01:06.902148 run osmo-hlr_10.42.42.2(pid=4476): stdout: | (launched: 2022-12-09_01:01:04.010574) 01:01:06.951814 run osmo-hlr_10.42.42.2(pid=4476): stderr: | 20221209010104190 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010104190 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010104190 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010104190 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010104190 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010104190 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010104202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010104210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010104210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010104211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:07.021123 run osmo-msc_10.42.42.6(pid=4482): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4482)] 01:01:07.069016 run osmo-msc_10.42.42.6(pid=4482): stdout: | (launched: 2022-12-09_01:01:05.942539) 01:01:07.118486 run osmo-msc_10.42.42.6(pid=4482): stderr: | 20221209010106216 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010106216 DLGLOBAL DEBUG validating counter group 0x7fbed9429c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010106216 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010106216 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010106216 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010106217 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010106218 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010106219 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010106219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010106219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:07.168778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4475): Terminating (SIGTERM) 01:01:07.209116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4478): Terminating (SIGTERM) 01:01:07.249294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4481): Terminating (SIGTERM) 01:01:07.289853 --- ParallelTerminationStrategy: PID 4475 died... 01:01:07.309017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4475): Terminated: ok {rc=0} 01:01:07.353656 --- ParallelTerminationStrategy: PID 4478 died... 01:01:07.372383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4478): Terminated: ok {rc=0} 01:01:07.416801 --- ParallelTerminationStrategy: PID 4481 died... 01:01:07.435931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4481): Terminated: ok {rc=0} 01:01:07.522934 bus /sierra_3: Setting Powered False 01:01:08.623250 bus /sierra_3: Setting Powered False 01:01:09.738919 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:01:10.886872 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:10.898778 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:01:10.970009 tst mo_mt_call_osmux.py: using LAC 17975 01:01:11.100090 tst mo_mt_call_osmux.py: using RAC 125 01:01:11.227603 tst mo_mt_call_osmux.py: using CellId 17975 01:01:11.348065 tst mo_mt_call_osmux.py: using BVCI 17976 01:01:11.469389 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:11.481269 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:11.492880 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:11.504499 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:11.516139 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:11.527879 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:01:11.647938 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:01:11.764485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:12.238370 run create_hlr_db(pid=4484): Launched 01:01:12.355328 bus /sierra_2: Setting Powered False 01:01:13.416125 run create_hlr_db(pid=4484): Terminated: ok {rc=0} 01:01:13.863134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4486): Launched 01:01:14.170245 run osmo-hlr_10.42.42.2(pid=4487): Launched 01:01:14.287332 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:14.821712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4489): Launched 01:01:15.126502 run osmo-stp_10.42.42.5(pid=4490): Launched 01:01:15.242887 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:15.794051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4492): Launched 01:01:16.164835 run osmo-msc_10.42.42.6(pid=4493): Launched 01:01:16.611416 run osmo-stp_10.42.42.5(pid=4490): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4490)] 01:01:16.826301 run osmo-stp_10.42.42.5(pid=4490): stdout: | (launched: 2022-12-09_01:01:15.070037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:16.966763 run osmo-stp_10.42.42.5(pid=4490): stderr: | 20221209010115242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010115242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010115242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010115243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010115243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010115243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010115243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:17.120054 run osmo-stp_10.42.42.5(pid=4490): stdout: | (launched: 2022-12-09_01:01:15.070037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:17.284391 run osmo-stp_10.42.42.5(pid=4490): stderr: | 20221209010115242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010115242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010115242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010115243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010115243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010115243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010115243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:17.441502 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4490): Process ended prematurely: osmo-stp_10.42.42.5(pid=4490) [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4490)] [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:01:17.450842 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 01:01:17.478650 run osmo-hlr_10.42.42.2(pid=4487): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4487)] 01:01:17.527635 run osmo-hlr_10.42.42.2(pid=4487): stdout: | (launched: 2022-12-09_01:01:14.113915) 01:01:17.578486 run osmo-hlr_10.42.42.2(pid=4487): stderr: | 20221209010114290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010114290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010114291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010114291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010114291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010114291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010114303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010114311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010114312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010114312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:17.649302 run osmo-msc_10.42.42.6(pid=4493): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4493)] 01:01:17.698250 run osmo-msc_10.42.42.6(pid=4493): stdout: | (launched: 2022-12-09_01:01:16.102793) 01:01:17.748772 run osmo-msc_10.42.42.6(pid=4493): stderr: | 20221209010116456 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010116457 DLGLOBAL DEBUG validating counter group 0x7fe1df53bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010116457 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010116457 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010116457 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010116457 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010116459 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010116459 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010116459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010116460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:17.799596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4486): Terminating (SIGTERM) 01:01:17.840046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4489): Terminating (SIGTERM) 01:01:17.880367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4492): Terminating (SIGTERM) 01:01:17.920801 --- ParallelTerminationStrategy: PID 4486 died... 01:01:17.940127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4486): Terminated: ok {rc=0} 01:01:17.985330 --- ParallelTerminationStrategy: PID 4489 died... 01:01:18.004153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4489): Terminated: ok {rc=0} 01:01:18.049614 --- ParallelTerminationStrategy: PID 4492 died... 01:01:18.068482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4492): Terminated: ok {rc=0} 01:01:18.156026 bus /sierra_3: Setting Powered False 01:01:19.255603 bus /sierra_3: Setting Powered False 01:01:20.372251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:01:21.620462 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:01:21.626226 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:01:21.660483 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:01:21.686796 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:01:21.740074 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:01:21.774187 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:01:21.801511 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:01:22.346329 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:01:22.396250 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:22.407265 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:01:22.479722 tst mo_mt_call.py: using LAC 17976 01:01:22.598314 tst mo_mt_call.py: using RAC 126 01:01:22.717917 tst mo_mt_call.py: using CellId 17976 01:01:22.841180 tst mo_mt_call.py: using BVCI 17977 01:01:22.952471 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:22.963402 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:22.974160 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:22.985279 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:22.996446 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:23.007792 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:01:23.128153 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:01:23.243441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:23.715946 run create_hlr_db(pid=4498): Launched 01:01:23.831731 bus /sierra_2: Setting Powered False 01:01:24.891672 run create_hlr_db(pid=4498): Terminated: ok {rc=0} 01:01:25.316419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4500): Launched 01:01:25.621382 run osmo-hlr_10.42.42.2(pid=4501): Launched 01:01:25.738417 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:26.277933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4503): Launched 01:01:26.583678 run osmo-stp_10.42.42.5(pid=4504): Launched 01:01:26.701109 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:27.253092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4506): Launched 01:01:27.558909 run osmo-msc_10.42.42.6(pid=4507): Launched 01:01:27.730035 run osmo-stp_10.42.42.5(pid=4504): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4504)] 01:01:27.859419 run osmo-stp_10.42.42.5(pid=4504): stdout: | (launched: 2022-12-09_01:01:26.527176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:27.988560 run osmo-stp_10.42.42.5(pid=4504): stderr: | 20221209010126698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010126699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010126699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010126699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010126702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010126702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010126702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:28.115637 run osmo-stp_10.42.42.5(pid=4504): stdout: | (launched: 2022-12-09_01:01:26.527176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:28.236537 run osmo-stp_10.42.42.5(pid=4504): stderr: | 20221209010126698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010126699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010126699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010126699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010126702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010126702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010126702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:28.382536 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4504): Process ended prematurely: osmo-stp_10.42.42.5(pid=4504) [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4504)] [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:01:28.391661 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:01:28.419044 run osmo-hlr_10.42.42.2(pid=4501): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4501)] 01:01:28.468101 run osmo-hlr_10.42.42.2(pid=4501): stdout: | (launched: 2022-12-09_01:01:25.564806) 01:01:28.518751 run osmo-hlr_10.42.42.2(pid=4501): stderr: | 20221209010125742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010125742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010125742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010125743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010125743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010125743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010125755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010125763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010125764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010125764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:28.588867 run osmo-msc_10.42.42.6(pid=4507): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4507)] 01:01:28.637340 run osmo-msc_10.42.42.6(pid=4507): stdout: | (launched: 2022-12-09_01:01:27.502421) 01:01:28.687674 run osmo-msc_10.42.42.6(pid=4507): stderr: | 20221209010127778 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010127778 DLGLOBAL DEBUG validating counter group 0x7f15388e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010127778 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010127778 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010127778 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010127778 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010127781 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010127781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010127781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010127781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:28.738562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4500): Terminating (SIGTERM) 01:01:28.779103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4503): Terminating (SIGTERM) 01:01:28.819685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4506): Terminating (SIGTERM) 01:01:28.860446 --- ParallelTerminationStrategy: PID 4500 died... 01:01:28.879900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4500): Terminated: ok {rc=0} 01:01:28.925408 --- ParallelTerminationStrategy: PID 4503 died... 01:01:28.944192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4503): Terminated: ok {rc=0} 01:01:28.989482 --- ParallelTerminationStrategy: PID 4506 died... 01:01:29.008387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4506): Terminated: ok {rc=0} 01:01:29.093128 bus /sierra_3: Setting Powered False 01:01:30.193173 bus /sierra_3: Setting Powered False 01:01:31.319838 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:01:32.487404 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:32.499385 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:01:32.572097 tst mo_mt_call_osmux.py: using LAC 17977 01:01:32.701371 tst mo_mt_call_osmux.py: using RAC 127 01:01:32.830526 tst mo_mt_call_osmux.py: using CellId 17977 01:01:32.959847 tst mo_mt_call_osmux.py: using BVCI 17978 01:01:33.078718 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:33.090109 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:33.101292 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:33.112443 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:33.123587 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:33.134759 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:01:33.250691 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:01:33.370334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:33.878901 run create_hlr_db(pid=4509): Launched 01:01:34.012605 bus /sierra_2: Setting Powered False 01:01:35.073541 run create_hlr_db(pid=4509): Terminated: ok {rc=0} 01:01:35.528608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4511): Launched 01:01:35.857769 run osmo-hlr_10.42.42.2(pid=4512): Launched 01:01:35.983176 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:36.547776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4514): Launched 01:01:36.878474 run osmo-stp_10.42.42.5(pid=4515): Launched 01:01:37.004451 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:37.597969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4517): Launched 01:01:37.926343 run osmo-msc_10.42.42.6(pid=4518): Launched 01:01:38.108298 run osmo-stp_10.42.42.5(pid=4515): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4515)] 01:01:38.245576 run osmo-stp_10.42.42.5(pid=4515): stdout: | (launched: 2022-12-09_01:01:36.818082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:38.383539 run osmo-stp_10.42.42.5(pid=4515): stderr: | 20221209010137015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010137015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010137016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010137016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010137017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010137017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010137017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:38.520740 run osmo-stp_10.42.42.5(pid=4515): stdout: | (launched: 2022-12-09_01:01:36.818082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:38.650396 run osmo-stp_10.42.42.5(pid=4515): stderr: | 20221209010137015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010137015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010137016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010137016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010137017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010137017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010137017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:38.806350 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4515): Process ended prematurely: osmo-stp_10.42.42.5(pid=4515) [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4515)] [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:01:38.815834 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 01:01:38.843989 run osmo-hlr_10.42.42.2(pid=4512): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4512)] 01:01:38.894272 run osmo-hlr_10.42.42.2(pid=4512): stdout: | (launched: 2022-12-09_01:01:35.797999) 01:01:38.946372 run osmo-hlr_10.42.42.2(pid=4512): stderr: | 20221209010135999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010135999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010135999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010135999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010135999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010136000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010136010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010136018 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010136018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010136018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:39.019067 run osmo-msc_10.42.42.6(pid=4518): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4518)] 01:01:39.069678 run osmo-msc_10.42.42.6(pid=4518): stdout: | (launched: 2022-12-09_01:01:37.865786) 01:01:39.122261 run osmo-msc_10.42.42.6(pid=4518): stderr: | 20221209010138189 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010138189 DLGLOBAL DEBUG validating counter group 0x7fdcdc5d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010138189 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010138189 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010138189 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010138190 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010138191 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010138192 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010138192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010138192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:39.174826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4511): Terminating (SIGTERM) 01:01:39.217047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4514): Terminating (SIGTERM) 01:01:39.259099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4517): Terminating (SIGTERM) 01:01:39.301232 --- ParallelTerminationStrategy: PID 4511 died... 01:01:39.320996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4511): Terminated: ok {rc=0} 01:01:39.367412 --- ParallelTerminationStrategy: PID 4514 died... 01:01:39.387051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4514): Terminated: ok {rc=0} 01:01:39.433308 --- ParallelTerminationStrategy: PID 4517 died... 01:01:39.452940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4517): Terminated: ok {rc=0} 01:01:39.542078 bus /sierra_3: Setting Powered False 01:01:40.639073 bus /sierra_3: Setting Powered False 01:01:41.753080 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 01:01:43.001346 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:01:43.006377 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 01:01:43.039726 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 01:01:43.066439 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 01:01:43.124930 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 01:01:43.158012 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 01:01:43.184191 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 01:01:43.731842 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 01:01:43.786392 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:43.797860 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 01:01:43.860368 tst mo_mt_call.py: using LAC 17978 01:01:43.988813 tst mo_mt_call.py: using RAC 128 01:01:44.115893 tst mo_mt_call.py: using CellId 17978 01:01:44.242574 tst mo_mt_call.py: using BVCI 17979 01:01:44.361220 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:44.372636 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:44.383843 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:44.395068 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:44.406248 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:44.417582 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:44.533918 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:44.653042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:45.124762 run create_hlr_db(pid=4523): Launched 01:01:45.241499 bus /sierra_2: Setting Powered False 01:01:46.299554 run create_hlr_db(pid=4523): Terminated: ok {rc=0} 01:01:46.735790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Launched 01:01:47.064446 run osmo-hlr_10.42.42.2(pid=4526): Launched 01:01:47.218155 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:47.747810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Launched 01:01:48.053676 run osmo-stp_10.42.42.5(pid=4529): Launched 01:01:48.170963 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:48.723220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4531): Launched 01:01:49.028139 run osmo-msc_10.42.42.6(pid=4532): Launched 01:01:49.199080 run osmo-stp_10.42.42.5(pid=4529): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] 01:01:49.327853 run osmo-stp_10.42.42.5(pid=4529): stdout: | (launched: 2022-12-09_01:01:47.997282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:49.457220 run osmo-stp_10.42.42.5(pid=4529): stderr: | 20221209010148168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010148168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010148169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010148169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010148171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010148171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010148171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:49.583265 run osmo-stp_10.42.42.5(pid=4529): stdout: | (launched: 2022-12-09_01:01:47.997282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:49.703731 run osmo-stp_10.42.42.5(pid=4529): stderr: | 20221209010148168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010148168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010148169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010148169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010148171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010148171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010148171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:49.847990 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4529): Process ended prematurely: osmo-stp_10.42.42.5(pid=4529) [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 01:01:49.857019 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:01:49.883694 run osmo-hlr_10.42.42.2(pid=4526): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4526)] 01:01:49.931844 run osmo-hlr_10.42.42.2(pid=4526): stdout: | (launched: 2022-12-09_01:01:47.003169) 01:01:49.981541 run osmo-hlr_10.42.42.2(pid=4526): stderr: | 20221209010147270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010147270 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010147270 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010147270 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010147270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010147270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010147282 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010147290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010147290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010147291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:50.050810 run osmo-msc_10.42.42.6(pid=4532): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4532)] 01:01:50.098978 run osmo-msc_10.42.42.6(pid=4532): stdout: | (launched: 2022-12-09_01:01:48.971896) 01:01:50.148469 run osmo-msc_10.42.42.6(pid=4532): stderr: | 20221209010149246 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010149247 DLGLOBAL DEBUG validating counter group 0x7fdeb69a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010149247 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010149247 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010149247 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010149247 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010149249 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010149249 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010149249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010149249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:50.198288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Terminating (SIGTERM) 01:01:50.237995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Terminating (SIGTERM) 01:01:50.278007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4531): Terminating (SIGTERM) 01:01:50.317918 --- ParallelTerminationStrategy: PID 4525 died... 01:01:50.336763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Terminated: ok {rc=0} 01:01:50.381185 --- ParallelTerminationStrategy: PID 4528 died... 01:01:50.399516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Terminated: ok {rc=0} 01:01:50.444137 --- ParallelTerminationStrategy: PID 4531 died... 01:01:50.462842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4531): Terminated: ok {rc=0} 01:01:50.549168 bus /sierra_3: Setting Powered False 01:01:51.648801 bus /sierra_3: Setting Powered False 01:01:52.764917 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 01:01:53.913389 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:53.924911 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 01:01:53.975679 tst mo_mt_call_osmux.py: using LAC 17979 01:01:54.100921 tst mo_mt_call_osmux.py: using RAC 129 01:01:54.221367 tst mo_mt_call_osmux.py: using CellId 17979 01:01:54.341328 tst mo_mt_call_osmux.py: using BVCI 17980 01:01:54.451278 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:54.462585 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:54.473586 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:54.485236 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:54.496933 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:54.508325 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:54.625452 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:54.745397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:55.251166 run create_hlr_db(pid=4534): Launched 01:01:55.383749 bus /sierra_2: Setting Powered False 01:01:56.447709 run create_hlr_db(pid=4534): Terminated: ok {rc=0} 01:01:56.883924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4536): Launched 01:01:57.190550 run osmo-hlr_10.42.42.2(pid=4537): Launched 01:01:57.309011 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:57.849546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4539): Launched 01:01:58.155934 run osmo-stp_10.42.42.5(pid=4540): Launched 01:01:58.271756 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:58.823594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4542): Launched 01:01:59.129268 run osmo-msc_10.42.42.6(pid=4543): Launched 01:01:59.299774 run osmo-stp_10.42.42.5(pid=4540): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4540)] 01:01:59.428770 run osmo-stp_10.42.42.5(pid=4540): stdout: | (launched: 2022-12-09_01:01:58.099410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:59.557408 run osmo-stp_10.42.42.5(pid=4540): stderr: | 20221209010158271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010158271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010158271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010158271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010158272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010158272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010158272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:59.684017 run osmo-stp_10.42.42.5(pid=4540): stdout: | (launched: 2022-12-09_01:01:58.099410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:59.805384 run osmo-stp_10.42.42.5(pid=4540): stderr: | 20221209010158271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010158271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010158271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010158271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010158272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010158272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010158272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:59.950155 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4540): Process ended prematurely: osmo-stp_10.42.42.5(pid=4540) [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4540)] [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 01:01:59.959263 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:01:59.987120 run osmo-hlr_10.42.42.2(pid=4537): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4537)] 01:02:00.035623 run osmo-hlr_10.42.42.2(pid=4537): stdout: | (launched: 2022-12-09_01:01:57.134085) 01:02:00.085630 run osmo-hlr_10.42.42.2(pid=4537): stderr: | 20221209010157312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010157312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010157312 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010157312 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010157312 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010157312 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010157324 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010157333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010157333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010157333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:00.154887 run osmo-msc_10.42.42.6(pid=4543): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4543)] 01:02:00.202932 run osmo-msc_10.42.42.6(pid=4543): stdout: | (launched: 2022-12-09_01:01:59.072557) 01:02:00.252197 run osmo-msc_10.42.42.6(pid=4543): stderr: | 20221209010159347 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010159348 DLGLOBAL DEBUG validating counter group 0x7ff6d4343c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010159348 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010159348 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010159348 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010159348 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010159350 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010159350 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010159350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010159350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:02:00.302169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4536): Terminating (SIGTERM) 01:02:00.341778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4539): Terminating (SIGTERM) 01:02:00.381387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4542): Terminating (SIGTERM) 01:02:00.421827 --- ParallelTerminationStrategy: PID 4536 died... 01:02:00.440714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4536): Terminated: ok {rc=0} 01:02:00.485575 --- ParallelTerminationStrategy: PID 4539 died... 01:02:00.504313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4539): Terminated: ok {rc=0} 01:02:00.549168 --- ParallelTerminationStrategy: PID 4542 died... 01:02:00.567802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4542): Terminated: ok {rc=0} 01:02:00.654795 bus /sierra_3: Setting Powered False 01:02:01.761467 bus /sierra_3: Setting Powered False 01:02:02.890686 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:02:04.134464 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:02:04.140567 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:02:04.174358 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 01:02:04.201301 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 01:02:04.254531 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:02:04.288841 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 01:02:04.315676 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 01:02:04.864373 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 01:02:04.913875 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:04.925082 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:02:04.977446 tst mo_mt_call.py: using LAC 17980 01:02:05.102696 tst mo_mt_call.py: using RAC 130 01:02:05.222479 tst mo_mt_call.py: using CellId 17980 01:02:05.341668 tst mo_mt_call.py: using BVCI 17981 01:02:05.452268 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:05.463544 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:05.474631 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:05.485884 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:05.497614 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:05.509606 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:02:05.624185 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:02:05.743504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:06.252439 run create_hlr_db(pid=4548): Launched 01:02:06.388117 bus /sierra_2: Setting Powered False 01:02:07.452591 run create_hlr_db(pid=4548): Terminated: ok {rc=0} 01:02:07.890745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4550): Launched 01:02:08.198156 run osmo-hlr_10.42.42.2(pid=4551): Launched 01:02:08.314791 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:08.857217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4553): Launched 01:02:09.164034 run osmo-stp_10.42.42.5(pid=4554): Launched 01:02:09.281117 run osmo-msc_10.42.42.6: Starting osmo-msc 01:02:09.833599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4556): Launched 01:02:10.140202 run osmo-msc_10.42.42.6(pid=4557): Launched 01:02:10.312717 run osmo-stp_10.42.42.5(pid=4554): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4554)] 01:02:10.442355 run osmo-stp_10.42.42.5(pid=4554): stdout: | (launched: 2022-12-09_01:02:09.107135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:10.571642 run osmo-stp_10.42.42.5(pid=4554): stderr: | 20221209010209279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010209279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010209280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010209280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010209280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010209280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010209281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:10.700413 run osmo-stp_10.42.42.5(pid=4554): stdout: | (launched: 2022-12-09_01:02:09.107135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:10.821957 run osmo-stp_10.42.42.5(pid=4554): stderr: | 20221209010209279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010209279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010209280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010209280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010209280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010209280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010209281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:10.967755 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4554): Process ended prematurely: osmo-stp_10.42.42.5(pid=4554) [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4554)] [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 01:02:10.977072 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:02:11.004765 run osmo-hlr_10.42.42.2(pid=4551): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4551)] 01:02:11.053389 run osmo-hlr_10.42.42.2(pid=4551): stdout: | (launched: 2022-12-09_01:02:08.141509) 01:02:11.103809 run osmo-hlr_10.42.42.2(pid=4551): stderr: | 20221209010208321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010208321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010208321 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010208321 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010208321 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010208321 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010208334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010208345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010208345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010208346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:11.174014 run osmo-msc_10.42.42.6(pid=4557): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4557)] 01:02:11.222239 run osmo-msc_10.42.42.6(pid=4557): stdout: | (launched: 2022-12-09_01:02:10.083491) 01:02:11.272207 run osmo-msc_10.42.42.6(pid=4557): stderr: | 20221209010210356 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010210356 DLGLOBAL DEBUG validating counter group 0x7fe1d9fe7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010210356 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010210356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010210356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010210357 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010210359 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010210359 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010210359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010210359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:02:11.322576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4550): Terminating (SIGTERM) 01:02:11.363014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4553): Terminating (SIGTERM) 01:02:11.403585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4556): Terminating (SIGTERM) 01:02:11.444377 --- ParallelTerminationStrategy: PID 4550 died... 01:02:11.463675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4550): Terminated: ok {rc=0} 01:02:11.508841 --- ParallelTerminationStrategy: PID 4553 died... 01:02:11.527993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4553): Terminated: ok {rc=0} 01:02:11.572687 --- ParallelTerminationStrategy: PID 4556 died... 01:02:11.591516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4556): Terminated: ok {rc=0} 01:02:11.677417 bus /sierra_3: Setting Powered False 01:02:12.778395 bus /sierra_3: Setting Powered False 01:02:13.896173 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 01:02:15.046310 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:15.058867 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:02:15.116549 tst mo_mt_call_osmux.py: using LAC 17981 01:02:15.246341 tst mo_mt_call_osmux.py: using RAC 131 01:02:15.373798 tst mo_mt_call_osmux.py: using CellId 17981 01:02:15.502896 tst mo_mt_call_osmux.py: using BVCI 17982 01:02:15.621699 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:15.633523 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:15.645033 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:15.656661 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:15.668320 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:15.679961 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:02:15.797298 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:02:15.942994 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:16.461141 run create_hlr_db(pid=4559): Launched 01:02:16.626422 bus /sierra_2: Setting Powered False 01:02:17.691022 run create_hlr_db(pid=4559): Terminated: ok {rc=0} 01:02:18.127229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Launched 01:02:18.433684 run osmo-hlr_10.42.42.2(pid=4562): Launched 01:02:18.550827 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:19.092294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Launched 01:02:19.398040 run osmo-stp_10.42.42.5(pid=4565): Launched 01:02:19.513605 run osmo-msc_10.42.42.6: Starting osmo-msc 01:02:20.065521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4567): Launched 01:02:20.371809 run osmo-msc_10.42.42.6(pid=4568): Launched 01:02:20.544792 run osmo-stp_10.42.42.5(pid=4565): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] 01:02:20.673887 run osmo-stp_10.42.42.5(pid=4565): stdout: | (launched: 2022-12-09_01:02:19.341585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:20.803403 run osmo-stp_10.42.42.5(pid=4565): stderr: | 20221209010219514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010219514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010219514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010219514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010219515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010219515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010219515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:20.930011 run osmo-stp_10.42.42.5(pid=4565): stdout: | (launched: 2022-12-09_01:02:19.341585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:21.050562 run osmo-stp_10.42.42.5(pid=4565): stderr: | 20221209010219514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010219514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010219514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010219514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010219515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010219515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010219515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:21.195163 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4565): Process ended prematurely: osmo-stp_10.42.42.5(pid=4565) [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 01:02:21.204040 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:02:21.230924 run osmo-hlr_10.42.42.2(pid=4562): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4562)] 01:02:21.278586 run osmo-hlr_10.42.42.2(pid=4562): stdout: | (launched: 2022-12-09_01:02:18.377342) 01:02:21.328011 run osmo-hlr_10.42.42.2(pid=4562): stderr: | 20221209010218552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010218552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010218552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010218552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010218552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010218552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010218564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010218573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010218573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010218573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:21.397084 run osmo-msc_10.42.42.6(pid=4568): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4568)] 01:02:21.445104 run osmo-msc_10.42.42.6(pid=4568): stdout: | (launched: 2022-12-09_01:02:20.315417) 01:02:21.494881 run osmo-msc_10.42.42.6(pid=4568): stderr: | 20221209010220587 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010220588 DLGLOBAL DEBUG validating counter group 0x7fc3990c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010220588 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010220588 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010220588 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010220588 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010220590 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010220590 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010220591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010220591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:02:21.545080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Terminating (SIGTERM) 01:02:21.584929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Terminating (SIGTERM) 01:02:21.624755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4567): Terminating (SIGTERM) 01:02:21.664697 --- ParallelTerminationStrategy: PID 4561 died... 01:02:21.683734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Terminated: ok {rc=0} 01:02:21.728172 --- ParallelTerminationStrategy: PID 4564 died... 01:02:21.746838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Terminated: ok {rc=0} 01:02:21.791131 --- ParallelTerminationStrategy: PID 4567 died... 01:02:21.809759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4567): Terminated: ok {rc=0} 01:02:21.895954 bus /sierra_3: Setting Powered False 01:02:22.995689 bus /sierra_3: Setting Powered False 01:02:24.110983 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 emergency:trx-b200 --------------------------------------------------------------------- 01:02:25.367271 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:02:25.372000 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 01:02:25.406613 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 01:02:25.434210 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 01:02:25.521573 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 01:02:25.555680 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 01:02:25.583266 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 01:02:26.167556 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2352 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 01:02:26.173184 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:26.184282 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 01:02:26.238669 tst emergency_mo_mt_call.py: using LAC 17982 01:02:26.365061 tst emergency_mo_mt_call.py: using RAC 132 01:02:26.492164 tst emergency_mo_mt_call.py: using CellId 17982 01:02:26.618177 tst emergency_mo_mt_call.py: using BVCI 17983 01:02:26.736588 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:26.747743 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:26.758694 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:26.769885 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:26.780871 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:26.791915 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:26.906798 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:27.025066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:27.523287 run create_hlr_db(pid=4573): Launched 01:02:27.653799 bus /sierra_2: Setting Powered False 01:02:28.717788 run create_hlr_db(pid=4573): Terminated: ok {rc=0} 01:02:29.148737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4575): Launched 01:02:29.449169 run osmo-hlr_10.42.42.2(pid=4576): Launched 01:02:29.564249 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:30.112185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4578): Launched 01:02:30.436329 run osmo-stp_10.42.42.5(pid=4579): Launched 01:02:30.570884 tst emergency_mo_mt_call.py: using MSISDN 6946 01:02:30.736404 run osmo-msc_10.42.42.6: Starting osmo-msc 01:02:31.347290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4581): Launched 01:02:31.684723 run osmo-msc_10.42.42.6(pid=4582): Launched 01:02:31.996822 run osmo-stp_10.42.42.5(pid=4579): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4579)] 01:02:32.261042 run osmo-stp_10.42.42.5(pid=4579): stdout: | (launched: 2022-12-09_01:02:30.377168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:32.387235 run osmo-stp_10.42.42.5(pid=4579): stderr: | 20221209010230571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010230572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010230572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010230572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010230573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010230573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010230573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:32.511774 run osmo-stp_10.42.42.5(pid=4579): stdout: | (launched: 2022-12-09_01:02:30.377168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:32.630368 run osmo-stp_10.42.42.5(pid=4579): stderr: | 20221209010230571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010230572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010230572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010230572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010230573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010230573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010230573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:32.772270 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4579): Process ended prematurely: osmo-stp_10.42.42.5(pid=4579) [trial-2352↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4579)] [trial-2352↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 01:02:32.780795 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 01:02:32.807458 run osmo-hlr_10.42.42.2(pid=4576): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4576)] 01:02:32.855993 run osmo-hlr_10.42.42.2(pid=4576): stdout: | (launched: 2022-12-09_01:02:29.392720) 01:02:32.905871 run osmo-hlr_10.42.42.2(pid=4576): stderr: | 20221209010229570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010229570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010229570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010229570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010229570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010229570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010229582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010229591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010229591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010229591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:32.975397 run osmo-msc_10.42.42.6(pid=4582): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4582)] 01:02:33.023487 run osmo-msc_10.42.42.6(pid=4582): stdout: | (launched: 2022-12-09_01:02:31.623374) 01:02:33.073297 run osmo-msc_10.42.42.6(pid=4582): stderr: | 20221209010232030 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010232031 DLGLOBAL DEBUG validating counter group 0x7fa40a7dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010232031 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010232031 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010232031 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010232031 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010232033 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010232034 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010232034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010232034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:02:33.123593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4575): Terminating (SIGTERM) 01:02:33.163591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4578): Terminating (SIGTERM) 01:02:33.203597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4581): Terminating (SIGTERM) 01:02:33.244196 --- ParallelTerminationStrategy: PID 4575 died... 01:02:33.263458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4575): Terminated: ok {rc=0} 01:02:33.308521 --- ParallelTerminationStrategy: PID 4578 died... 01:02:33.327220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4578): Terminated: ok {rc=0} 01:02:33.371749 --- ParallelTerminationStrategy: PID 4581 died... 01:02:33.390485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4581): Terminated: ok {rc=0} 01:02:33.478007 bus /sierra_3: Setting Powered False 01:02:34.578310 bus /sierra_3: Setting Powered False 01:02:35.694269 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 01:02:36.782873 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:36.794220 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 01:02:36.845450 tst emergency_preemptive_call.py: using LAC 17983 01:02:36.967312 tst emergency_preemptive_call.py: using RAC 133 01:02:37.085223 tst emergency_preemptive_call.py: using CellId 17983 01:02:37.202481 tst emergency_preemptive_call.py: using BVCI 17984 01:02:37.310421 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:37.321137 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:37.331611 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:37.342357 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:37.353036 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:37.363610 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:37.480890 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:37.602486 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:37.716503 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:37.836578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:38.336323 run create_hlr_db(pid=4585): Launched 01:02:38.469593 bus /sierra_2: Setting Powered False 01:02:39.533225 run create_hlr_db(pid=4585): Terminated: ok {rc=0} 01:02:39.962529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4587): Launched 01:02:40.265471 run osmo-hlr_10.42.42.2(pid=4588): Launched 01:02:40.379936 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:40.913638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4590): Launched 01:02:41.215182 run osmo-stp_10.42.42.5(pid=4591): Launched 01:02:41.339705 tst emergency_preemptive_call.py: using MSISDN 6947 01:02:41.493267 run osmo-msc_10.42.42.6: Starting osmo-msc 01:02:42.029728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4593): Launched 01:02:42.329447 run osmo-msc_10.42.42.6(pid=4594): Launched 01:02:42.497943 run osmo-stp_10.42.42.5(pid=4591): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4591)] 01:02:42.625635 run osmo-stp_10.42.42.5(pid=4591): stdout: | (launched: 2022-12-09_01:02:41.159216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:42.753187 run osmo-stp_10.42.42.5(pid=4591): stderr: | 20221209010241331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010241332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010241332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010241333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010241333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010241334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010241334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:42.878699 run osmo-stp_10.42.42.5(pid=4591): stdout: | (launched: 2022-12-09_01:02:41.159216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:42.998912 run osmo-stp_10.42.42.5(pid=4591): stderr: | 20221209010241331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010241332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010241332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010241333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010241333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010241334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010241334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:43.141818 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4591): Process ended prematurely: osmo-stp_10.42.42.5(pid=4591) [trial-2352↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4591)] [trial-2352↪emergency:trx-b200↪emergency_preemptive_call.py:32] 01:02:43.150031 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 01:02:43.176404 run osmo-hlr_10.42.42.2(pid=4588): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4588)] 01:02:43.225458 run osmo-hlr_10.42.42.2(pid=4588): stdout: | (launched: 2022-12-09_01:02:40.209199) 01:02:43.275886 run osmo-hlr_10.42.42.2(pid=4588): stderr: | 20221209010240386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010240386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010240386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010240386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010240386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010240386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010240399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010240408 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010240408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010240408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:43.345913 run osmo-msc_10.42.42.6(pid=4594): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4594)] 01:02:43.394773 run osmo-msc_10.42.42.6(pid=4594): stdout: | (launched: 2022-12-09_01:02:42.273746) 01:02:43.445314 run osmo-msc_10.42.42.6(pid=4594): stderr: | 20221209010242547 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010242548 DLGLOBAL DEBUG validating counter group 0x7fc16d052c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010242548 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010242548 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010242548 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010242549 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010242550 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010242551 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010242551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010242551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:02:43.495793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4587): Terminating (SIGTERM) 01:02:43.535985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4590): Terminating (SIGTERM) 01:02:43.576384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4593): Terminating (SIGTERM) 01:02:43.616919 --- ParallelTerminationStrategy: PID 4587 died... 01:02:43.636257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4587): Terminated: ok {rc=0} 01:02:43.681497 --- ParallelTerminationStrategy: PID 4590 died... 01:02:43.700264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4590): Terminated: ok {rc=0} 01:02:43.745148 --- ParallelTerminationStrategy: PID 4593 died... 01:02:43.763835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4593): Terminated: ok {rc=0} 01:02:43.851202 bus /sierra_9: Setting Powered False 01:02:44.952744 bus /sierra_9: Setting Powered False 01:02:46.081881 bus /sierra_8: Setting Powered False 01:02:47.196422 bus /sierra_8: Setting Powered False 01:02:48.316109 bus /sierra_3: Setting Powered False 01:02:49.416147 bus /sierra_3: Setting Powered False 01:02:50.533348 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-b200 --------------------------------------------------------------------- 01:02:51.824527 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:02:51.829391 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 01:02:51.863614 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 01:02:51.903436 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 01:02:51.994475 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 01:02:52.028794 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 01:02:52.068158 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 01:02:52.656871 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 01:02:52.710387 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:52.721463 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:02:52.771950 tst cs_paging_gprs_active.py: using LAC 17984 01:02:52.902441 tst cs_paging_gprs_active.py: using RAC 134 01:02:53.030730 tst cs_paging_gprs_active.py: using CellId 17984 01:02:53.160734 tst cs_paging_gprs_active.py: using BVCI 17985 01:02:53.281212 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:53.292269 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:53.303036 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:53.313932 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:53.324634 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:53.335330 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:53.346436 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:53.357309 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:53.368300 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:53.484225 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:53.606554 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:02:53.828630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:54.158008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4599): Launched 01:02:54.444642 run iperf3-srv_10.42.42.10(pid=4600): Launched 01:02:54.568245 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:02:54.789318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:55.120121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4601): Launched 01:02:55.408186 run iperf3-srv_10.42.42.10(pid=4602): Launched 01:02:55.532713 tst cs_paging_gprs_active.py:38: start network... 01:02:55.753351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:56.262802 run create_hlr_db(pid=4603): Launched 01:02:56.396385 bus /sierra_2: Setting Powered False 01:02:57.460878 run create_hlr_db(pid=4603): Terminated: ok {rc=0} 01:02:57.917843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4605): Launched 01:02:58.246276 run osmo-hlr_10.42.42.2(pid=4606): Launched 01:02:58.371343 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:58.943675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4608): Launched 01:02:59.273220 run osmo-stp_10.42.42.5(pid=4609): Launched 01:02:59.399287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:02:59.962561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4611): Launched 01:03:00.089160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:00.366213 run patchelf(pid=4612): Launched 01:03:00.551123 run osmo-stp_10.42.42.5(pid=4609): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4609)] 01:03:00.690631 run osmo-stp_10.42.42.5(pid=4609): stdout: | (launched: 2022-12-09_01:02:59.213022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:00.831919 run osmo-stp_10.42.42.5(pid=4609): stderr: | 20221209010259406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010259406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010259406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010259407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010259407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010259407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010259407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:00.975390 run osmo-stp_10.42.42.5(pid=4609): stdout: | (launched: 2022-12-09_01:02:59.213022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:01.135510 run osmo-stp_10.42.42.5(pid=4609): stderr: | 20221209010259406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010259406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010259406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010259407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010259407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010259407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010259407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:01.298403 run patchelf(pid=4612): Terminating (SIGINT) 01:03:01.486110 run patchelf(pid=4612): Terminated: ok {rc=0} 01:03:01.620937 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4609): Process ended prematurely: osmo-stp_10.42.42.5(pid=4609) [trial-2352↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4609)] [trial-2352↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 01:03:01.631980 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 01:03:01.666267 run osmo-hlr_10.42.42.2(pid=4606): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4606)] 01:03:01.726696 run osmo-hlr_10.42.42.2(pid=4606): stdout: | (launched: 2022-12-09_01:02:58.185525) 01:03:01.791112 run osmo-hlr_10.42.42.2(pid=4606): stderr: | 20221209010258385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010258386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010258386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010258386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010258386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010258386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010258398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010258406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010258406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010258406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:01.855642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4599): Terminating (SIGTERM) 01:03:01.908201 run iperf3-srv_10.42.42.10(pid=4600): Terminating (SIGTERM) 01:03:01.963922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4601): Terminating (SIGTERM) 01:03:02.016208 run iperf3-srv_10.42.42.10(pid=4602): Terminating (SIGTERM) 01:03:02.072684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4605): Terminating (SIGTERM) 01:03:02.124803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4608): Terminating (SIGTERM) 01:03:02.175635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4611): Terminating (SIGTERM) 01:03:02.220282 --- ParallelTerminationStrategy: PID 4599 died... 01:03:02.240338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4599): Terminated: ok {rc=0} 01:03:02.288904 --- ParallelTerminationStrategy: PID 4600 died... 01:03:02.307825 run iperf3-srv_10.42.42.10(pid=4600): Terminated {rc=256} 01:03:02.353854 --- ParallelTerminationStrategy: PID 4601 died... 01:03:02.372625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4601): Terminated: ok {rc=0} 01:03:02.418455 --- ParallelTerminationStrategy: PID 4602 died... 01:03:02.437332 run iperf3-srv_10.42.42.10(pid=4602): Terminated {rc=256} 01:03:02.482599 --- ParallelTerminationStrategy: PID 4605 died... 01:03:02.501420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4605): Terminated: ok {rc=0} 01:03:02.546260 --- ParallelTerminationStrategy: PID 4608 died... 01:03:02.565152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4608): Terminated: ok {rc=0} 01:03:02.610268 --- ParallelTerminationStrategy: PID 4611 died... 01:03:02.629204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4611): Terminated: ok {rc=0} 01:03:02.716830 bus /gobi_0: Setting Powered False 01:03:03.817334 bus /gobi_0: Setting Powered False 01:03:04.935038 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200 iperf3.py ---------------------------------------------- 01:03:06.084294 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:06.095879 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:03:06.150266 tst iperf3.py: using LAC 17985 01:03:06.271724 tst iperf3.py: using RAC 135 01:03:06.390856 tst iperf3.py: using CellId 17985 01:03:06.512480 tst iperf3.py: using BVCI 17986 01:03:06.626077 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:06.636724 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:06.647219 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:06.657834 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:06.668149 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:06.678646 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:06.689140 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:06.699517 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:06.709928 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:06.829758 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:03:07.051652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:07.382639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4614): Launched 01:03:07.670023 run iperf3-srv_10.42.42.10(pid=4615): Launched 01:03:07.793291 tst iperf3.py:8: start network... 01:03:08.015236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:08.523576 run create_hlr_db(pid=4616): Launched 01:03:08.659015 bus /gobi_6: Setting Powered False 01:03:09.723433 run create_hlr_db(pid=4616): Terminated: ok {rc=0} 01:03:10.161161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4618): Launched 01:03:10.468000 run osmo-hlr_10.42.42.2(pid=4619): Launched 01:03:10.587089 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:11.129195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4621): Launched 01:03:11.435352 run osmo-stp_10.42.42.5(pid=4622): Launched 01:03:11.552207 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:12.078591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4624): Launched 01:03:12.195768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:12.454483 run patchelf(pid=4625): Launched 01:03:12.625258 run osmo-stp_10.42.42.5(pid=4622): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4622)] 01:03:12.755083 run osmo-stp_10.42.42.5(pid=4622): stdout: | (launched: 2022-12-09_01:03:11.378982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:12.886357 run osmo-stp_10.42.42.5(pid=4622): stderr: | 20221209010311552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010311552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010311552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010311553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010311553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010311553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010311553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:13.017516 run osmo-stp_10.42.42.5(pid=4622): stdout: | (launched: 2022-12-09_01:03:11.378982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:13.142688 run osmo-stp_10.42.42.5(pid=4622): stderr: | 20221209010311552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010311552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010311552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010311553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010311553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010311553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010311553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:13.291161 run patchelf(pid=4625): Terminating (SIGINT) 01:03:13.462478 run patchelf(pid=4625): Terminated: ok {rc=0} 01:03:13.586253 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4622): Process ended prematurely: osmo-stp_10.42.42.5(pid=4622) [trial-2352↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4622)] [trial-2352↪gprs:trx-b200↪iperf3.py:8] 01:03:13.595712 tst iperf3.py:8: Test FAILED (7.5 sec) 01:03:13.623305 run osmo-hlr_10.42.42.2(pid=4619): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4619)] 01:03:13.672282 run osmo-hlr_10.42.42.2(pid=4619): stdout: | (launched: 2022-12-09_01:03:10.410831) 01:03:13.722757 run osmo-hlr_10.42.42.2(pid=4619): stderr: | 20221209010310588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010310588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010310588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010310588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010310588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010310589 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010310600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010310608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010310609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010310609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:13.773017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4614): Terminating (SIGTERM) 01:03:13.813401 run iperf3-srv_10.42.42.10(pid=4615): Terminating (SIGTERM) 01:03:13.853546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4618): Terminating (SIGTERM) 01:03:13.893755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4621): Terminating (SIGTERM) 01:03:13.933766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4624): Terminating (SIGTERM) 01:03:13.973931 --- ParallelTerminationStrategy: PID 4614 died... 01:03:13.993257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4614): Terminated: ok {rc=0} 01:03:14.038438 --- ParallelTerminationStrategy: PID 4615 died... 01:03:14.057427 run iperf3-srv_10.42.42.10(pid=4615): Terminated {rc=256} 01:03:14.102345 --- ParallelTerminationStrategy: PID 4618 died... 01:03:14.121304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4618): Terminated: ok {rc=0} 01:03:14.166019 --- ParallelTerminationStrategy: PID 4621 died... 01:03:14.184904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4621): Terminated: ok {rc=0} 01:03:14.229758 --- ParallelTerminationStrategy: PID 4624 died... 01:03:14.248378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4624): Terminated: ok {rc=0} 01:03:14.333086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 01:03:15.484000 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:15.496029 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:03:15.547859 tst iperf3m4.py: using LAC 17986 01:03:15.677585 tst iperf3m4.py: using RAC 136 01:03:15.805462 tst iperf3m4.py: using CellId 17986 01:03:15.951806 tst iperf3m4.py: using BVCI 17987 01:03:16.072629 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:16.084482 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:16.096128 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:16.108060 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:16.119603 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:16.131386 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:16.143198 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:16.155038 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:16.167107 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:16.285826 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:16.422467 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:16.546616 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:16.689106 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:03:16.966318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:17.282129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4626): Launched 01:03:17.581252 run iperf3-srv_10.42.42.10(pid=4627): Launched 01:03:17.704840 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:03:17.927202 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:18.257171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4628): Launched 01:03:18.542320 run iperf3-srv_10.42.42.10(pid=4629): Launched 01:03:18.667245 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:03:18.889388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:19.219642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4630): Launched 01:03:19.508544 run iperf3-srv_10.42.42.10(pid=4631): Launched 01:03:19.633033 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:03:19.854453 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:20.183662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4632): Launched 01:03:20.471131 run iperf3-srv_10.42.42.10(pid=4633): Launched 01:03:20.595551 tst iperf3m4.py:8: start network... 01:03:20.816903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:21.326206 run create_hlr_db(pid=4634): Launched 01:03:21.460763 bus /gobi_6: Setting Powered False 01:03:22.525433 run create_hlr_db(pid=4634): Terminated: ok {rc=0} 01:03:22.961917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4636): Launched 01:03:23.268370 run osmo-hlr_10.42.42.2(pid=4637): Launched 01:03:23.384566 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:23.927476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4639): Launched 01:03:24.233548 run osmo-stp_10.42.42.5(pid=4640): Launched 01:03:24.350694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:24.877591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4642): Launched 01:03:24.994848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:25.254695 run patchelf(pid=4643): Launched 01:03:25.427794 run osmo-stp_10.42.42.5(pid=4640): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4640)] 01:03:25.558693 run osmo-stp_10.42.42.5(pid=4640): stdout: | (launched: 2022-12-09_01:03:24.176493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:25.689965 run osmo-stp_10.42.42.5(pid=4640): stderr: | 20221209010324348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010324349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010324349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010324349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010324351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010324352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010324352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:25.821433 run osmo-stp_10.42.42.5(pid=4640): stdout: | (launched: 2022-12-09_01:03:24.176493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:25.946696 run osmo-stp_10.42.42.5(pid=4640): stderr: | 20221209010324348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010324349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010324349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010324349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010324351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010324352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010324352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:26.095166 run patchelf(pid=4643): Terminating (SIGINT) 01:03:26.267624 run patchelf(pid=4643): Terminated: ok {rc=0} 01:03:26.391636 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4640): Process ended prematurely: osmo-stp_10.42.42.5(pid=4640) [trial-2352↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4640)] [trial-2352↪gprs:trx-b200↪iperf3m4.py:8] 01:03:26.401260 tst iperf3m4.py:8: Test FAILED (11.0 sec) 01:03:26.429669 run osmo-hlr_10.42.42.2(pid=4637): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4637)] 01:03:26.478144 run osmo-hlr_10.42.42.2(pid=4637): stdout: | (launched: 2022-12-09_01:03:23.211489) 01:03:26.528340 run osmo-hlr_10.42.42.2(pid=4637): stderr: | 20221209010323389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010323389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010323389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010323389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010323389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010323389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010323402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010323411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010323411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010323411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:26.578973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4626): Terminating (SIGTERM) 01:03:26.619254 run iperf3-srv_10.42.42.10(pid=4627): Terminating (SIGTERM) 01:03:26.659504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4628): Terminating (SIGTERM) 01:03:26.699984 run iperf3-srv_10.42.42.10(pid=4629): Terminating (SIGTERM) 01:03:26.740566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4630): Terminating (SIGTERM) 01:03:26.781028 run iperf3-srv_10.42.42.10(pid=4631): Terminating (SIGTERM) 01:03:26.821257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4632): Terminating (SIGTERM) 01:03:26.861676 run iperf3-srv_10.42.42.10(pid=4633): Terminating (SIGTERM) 01:03:26.902166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4636): Terminating (SIGTERM) 01:03:26.942598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4639): Terminating (SIGTERM) 01:03:26.982995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4642): Terminating (SIGTERM) 01:03:27.023806 --- ParallelTerminationStrategy: PID 4626 died... 01:03:27.043085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4626): Terminated: ok {rc=0} 01:03:27.088094 --- ParallelTerminationStrategy: PID 4627 died... 01:03:27.106918 run iperf3-srv_10.42.42.10(pid=4627): Terminated {rc=256} 01:03:27.151573 --- ParallelTerminationStrategy: PID 4628 died... 01:03:27.170665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4628): Terminated: ok {rc=0} 01:03:27.215387 --- ParallelTerminationStrategy: PID 4629 died... 01:03:27.234237 run iperf3-srv_10.42.42.10(pid=4629): Terminated {rc=256} 01:03:27.279079 --- ParallelTerminationStrategy: PID 4630 died... 01:03:27.298154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4630): Terminated: ok {rc=0} 01:03:27.342982 --- ParallelTerminationStrategy: PID 4631 died... 01:03:27.361820 run iperf3-srv_10.42.42.10(pid=4631): Terminated {rc=256} 01:03:27.407026 --- ParallelTerminationStrategy: PID 4632 died... 01:03:27.425785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4632): Terminated: ok {rc=0} 01:03:27.471137 --- ParallelTerminationStrategy: PID 4633 died... 01:03:27.489999 run iperf3-srv_10.42.42.10(pid=4633): Terminated {rc=256} 01:03:27.534547 --- ParallelTerminationStrategy: PID 4636 died... 01:03:27.553423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4636): Terminated: ok {rc=0} 01:03:27.598183 --- ParallelTerminationStrategy: PID 4639 died... 01:03:27.617105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4639): Terminated: ok {rc=0} 01:03:27.661992 --- ParallelTerminationStrategy: PID 4642 died... 01:03:27.681103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4642): Terminated: ok {rc=0} 01:03:27.766996 bus /gobi_4: Setting Powered False 01:03:28.866704 bus /gobi_4: Setting Powered False 01:03:29.983883 bus /gobi_1: Setting Powered False 01:03:31.095991 bus /gobi_1: Setting Powered False 01:03:32.233577 bus /gobi_0: Setting Powered False 01:03:33.333319 bus /gobi_0: Setting Powered False 01:03:34.450404 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200 ping.py ---------------------------------------------- 01:03:35.555133 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:35.567186 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:03:35.618109 tst ping.py: using LAC 17987 01:03:35.745464 tst ping.py: using RAC 137 01:03:35.872669 tst ping.py: using CellId 17987 01:03:36.002815 tst ping.py: using BVCI 17988 01:03:36.121050 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:36.132138 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:36.143106 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:36.154031 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:36.164795 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:36.175674 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:36.186688 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:36.197680 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:36.313573 tst ping.py:19: start network... 01:03:36.531657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:37.029169 run create_hlr_db(pid=4644): Launched 01:03:37.158892 bus /gobi_6: Setting Powered False 01:03:38.222358 run create_hlr_db(pid=4644): Terminated: ok {rc=0} 01:03:38.670206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4647): Launched 01:03:38.993075 run osmo-hlr_10.42.42.2(pid=4648): Launched 01:03:39.117510 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:39.674553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4650): Launched 01:03:39.999460 run osmo-stp_10.42.42.5(pid=4651): Launched 01:03:40.122527 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:40.677771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4653): Launched 01:03:40.801405 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:41.074845 run patchelf(pid=4654): Launched 01:03:41.255200 run osmo-stp_10.42.42.5(pid=4651): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4651)] 01:03:41.392261 run osmo-stp_10.42.42.5(pid=4651): stdout: | (launched: 2022-12-09_01:03:39.939478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:41.530979 run osmo-stp_10.42.42.5(pid=4651): stderr: | 20221209010340135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010340135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010340135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010340135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010340136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010340136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010340136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:41.669555 run osmo-stp_10.42.42.5(pid=4651): stdout: | (launched: 2022-12-09_01:03:39.939478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:41.801531 run osmo-stp_10.42.42.5(pid=4651): stderr: | 20221209010340135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010340135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010340135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010340135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010340136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010340136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010340136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:41.958823 run patchelf(pid=4654): Terminating (SIGINT) 01:03:42.138853 run patchelf(pid=4654): Terminated: ok {rc=0} 01:03:42.268358 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4651): Process ended prematurely: osmo-stp_10.42.42.5(pid=4651) [trial-2352↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4651)] [trial-2352↪gprs:trx-b200↪ping.py:22] 01:03:42.278113 tst ping.py:22: Test FAILED (6.7 sec) 01:03:42.306480 run osmo-hlr_10.42.42.2(pid=4648): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4648)] 01:03:42.357199 run osmo-hlr_10.42.42.2(pid=4648): stdout: | (launched: 2022-12-09_01:03:38.933675) 01:03:42.409781 run osmo-hlr_10.42.42.2(pid=4648): stderr: | 20221209010339136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010339136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010339136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010339136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010339136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010339136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010339149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010339157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010339157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010339157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:42.462746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4647): Terminating (SIGTERM) 01:03:42.505225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4650): Terminating (SIGTERM) 01:03:42.547585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4653): Terminating (SIGTERM) 01:03:42.590176 --- ParallelTerminationStrategy: PID 4647 died... 01:03:42.610549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4647): Terminated: ok {rc=0} 01:03:42.657741 --- ParallelTerminationStrategy: PID 4650 died... 01:03:42.677546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4650): Terminated: ok {rc=0} 01:03:42.724639 --- ParallelTerminationStrategy: PID 4653 died... 01:03:42.744551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4653): Terminated: ok {rc=0} 01:03:42.833824 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 01:03:43.922235 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:43.934454 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:03:43.986135 tst ping_idle_ping.py: using LAC 17988 01:03:44.112738 tst ping_idle_ping.py: using RAC 138 01:03:44.241201 tst ping_idle_ping.py: using CellId 17988 01:03:44.368818 tst ping_idle_ping.py: using BVCI 17989 01:03:44.487028 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:44.498645 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:44.509656 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:44.520536 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:44.531391 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:44.542263 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:44.553394 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:44.564316 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:44.679423 tst ping_idle_ping.py:24: start network... 01:03:44.880734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:45.346834 run create_hlr_db(pid=4655): Launched 01:03:45.464882 bus /gobi_6: Setting Powered False 01:03:46.529347 run create_hlr_db(pid=4655): Terminated: ok {rc=0} 01:03:46.992412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4657): Launched 01:03:47.326858 run osmo-hlr_10.42.42.2(pid=4658): Launched 01:03:47.452222 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:48.013332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4660): Launched 01:03:48.338545 run osmo-stp_10.42.42.5(pid=4661): Launched 01:03:48.463074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:49.021889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4663): Launched 01:03:49.146688 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:49.419615 run patchelf(pid=4664): Launched 01:03:49.599624 run osmo-stp_10.42.42.5(pid=4661): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4661)] 01:03:49.736518 run osmo-stp_10.42.42.5(pid=4661): stdout: | (launched: 2022-12-09_01:03:48.278825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:49.875523 run osmo-stp_10.42.42.5(pid=4661): stderr: | 20221209010348473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010348473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010348473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010348474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010348474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010348474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010348474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:50.014624 run osmo-stp_10.42.42.5(pid=4661): stdout: | (launched: 2022-12-09_01:03:48.278825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:50.147054 run osmo-stp_10.42.42.5(pid=4661): stderr: | 20221209010348473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010348473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010348473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010348474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010348474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010348474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010348474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:50.304003 run patchelf(pid=4664): Terminating (SIGINT) 01:03:50.485184 run patchelf(pid=4664): Terminated: ok {rc=0} 01:03:50.615538 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4661): Process ended prematurely: osmo-stp_10.42.42.5(pid=4661) [trial-2352↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4661)] [trial-2352↪gprs:trx-b200↪ping_idle_ping.py:27] 01:03:50.625254 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:03:50.653813 run osmo-hlr_10.42.42.2(pid=4658): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4658)] 01:03:50.704438 run osmo-hlr_10.42.42.2(pid=4658): stdout: | (launched: 2022-12-09_01:03:47.267338) 01:03:50.756777 run osmo-hlr_10.42.42.2(pid=4658): stderr: | 20221209010347467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010347467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010347468 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010347468 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010347468 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010347468 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010347480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010347488 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010347489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010347489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:50.809575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4657): Terminating (SIGTERM) 01:03:50.852221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4660): Terminating (SIGTERM) 01:03:50.894865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4663): Terminating (SIGTERM) 01:03:50.937686 --- ParallelTerminationStrategy: PID 4657 died... 01:03:50.958145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4657): Terminated: ok {rc=0} 01:03:51.005442 --- ParallelTerminationStrategy: PID 4660 died... 01:03:51.025426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4660): Terminated: ok {rc=0} 01:03:51.072353 --- ParallelTerminationStrategy: PID 4663 died... 01:03:51.092426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4663): Terminated: ok {rc=0} 01:03:51.181077 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 01:03:52.497232 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:03:52.504124 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:03:52.538868 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:03:52.577363 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:03:52.662010 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:03:52.694917 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:03:52.732844 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:03:53.325766 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:03:53.375381 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:53.386183 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:03:53.434747 tst cs_paging_gprs_active.py: using LAC 17989 01:03:53.557526 tst cs_paging_gprs_active.py: using RAC 139 01:03:53.685603 tst cs_paging_gprs_active.py: using CellId 17989 01:03:53.818921 tst cs_paging_gprs_active.py: using BVCI 17990 01:03:53.940666 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:53.952213 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:53.963494 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:53.974978 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:53.986626 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:53.998058 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:54.009736 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:54.021210 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:54.032489 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:54.150776 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:54.270728 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:03:54.493519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:54.824199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4668): Launched 01:03:55.114085 run iperf3-srv_10.42.42.10(pid=4669): Launched 01:03:55.238521 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:03:55.460572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:55.792928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4670): Launched 01:03:56.081538 run iperf3-srv_10.42.42.10(pid=4671): Launched 01:03:56.205950 tst cs_paging_gprs_active.py:38: start network... 01:03:56.429191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:56.941449 run create_hlr_db(pid=4672): Launched 01:03:57.075511 bus /gobi_6: Setting Powered False 01:03:58.139621 run create_hlr_db(pid=4672): Terminated: ok {rc=0} 01:03:58.596381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4674): Launched 01:03:58.926065 run osmo-hlr_10.42.42.2(pid=4675): Launched 01:03:59.051426 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:59.614616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4677): Launched 01:03:59.945682 run osmo-stp_10.42.42.5(pid=4678): Launched 01:04:00.072914 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:00.639918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4680): Launched 01:04:00.767948 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:01.061746 run patchelf(pid=4681): Launched 01:04:01.253543 run osmo-stp_10.42.42.5(pid=4678): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4678)] 01:04:01.395059 run osmo-stp_10.42.42.5(pid=4678): stdout: | (launched: 2022-12-09_01:03:59.885224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:01.538799 run osmo-stp_10.42.42.5(pid=4678): stderr: | 20221209010400079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010400079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010400079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010400080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010400080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010400080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010400080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:01.683527 run osmo-stp_10.42.42.5(pid=4678): stdout: | (launched: 2022-12-09_01:03:59.885224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:01.820080 run osmo-stp_10.42.42.5(pid=4678): stderr: | 20221209010400079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010400079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010400079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010400080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010400080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010400080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010400080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:01.978722 run patchelf(pid=4681): Terminating (SIGINT) 01:04:02.158435 run patchelf(pid=4681): Terminated: ok {rc=0} 01:04:02.286703 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4678): Process ended prematurely: osmo-stp_10.42.42.5(pid=4678) [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4678)] [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:04:02.298984 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 01:04:02.328938 run osmo-hlr_10.42.42.2(pid=4675): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4675)] 01:04:02.378785 run osmo-hlr_10.42.42.2(pid=4675): stdout: | (launched: 2022-12-09_01:03:58.865226) 01:04:02.429986 run osmo-hlr_10.42.42.2(pid=4675): stderr: | 20221209010359063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010359063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010359063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010359063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010359063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010359063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010359076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010359085 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010359085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010359085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:02.481502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4668): Terminating (SIGTERM) 01:04:02.522935 run iperf3-srv_10.42.42.10(pid=4669): Terminating (SIGTERM) 01:04:02.564179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4670): Terminating (SIGTERM) 01:04:02.605550 run iperf3-srv_10.42.42.10(pid=4671): Terminating (SIGTERM) 01:04:02.646509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4674): Terminating (SIGTERM) 01:04:02.687870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4677): Terminating (SIGTERM) 01:04:02.729352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4680): Terminating (SIGTERM) 01:04:02.770567 --- ParallelTerminationStrategy: PID 4668 died... 01:04:02.791284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4668): Terminated: ok {rc=0} 01:04:02.841878 --- ParallelTerminationStrategy: PID 4669 died... 01:04:02.873201 run iperf3-srv_10.42.42.10(pid=4669): Terminated {rc=256} 01:04:02.950170 --- ParallelTerminationStrategy: PID 4670 died... 01:04:02.970414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4670): Terminated: ok {rc=0} 01:04:03.016709 --- ParallelTerminationStrategy: PID 4671 died... 01:04:03.036319 run iperf3-srv_10.42.42.10(pid=4671): Terminated {rc=256} 01:04:03.082497 --- ParallelTerminationStrategy: PID 4674 died... 01:04:03.102544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4674): Terminated: ok {rc=0} 01:04:03.149315 --- ParallelTerminationStrategy: PID 4677 died... 01:04:03.169398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4677): Terminated: ok {rc=0} 01:04:03.215560 --- ParallelTerminationStrategy: PID 4680 died... 01:04:03.235299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4680): Terminated: ok {rc=0} 01:04:03.323122 bus /gobi_0: Setting Powered False 01:04:04.422888 bus /gobi_0: Setting Powered False 01:04:05.538111 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:04:06.688244 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:06.700113 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:04:06.754156 tst iperf3.py: using LAC 17990 01:04:06.882639 tst iperf3.py: using RAC 140 01:04:07.011352 tst iperf3.py: using CellId 17990 01:04:07.144549 tst iperf3.py: using BVCI 17991 01:04:07.265062 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:07.276376 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:07.287430 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:07.298531 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:07.309637 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:07.320601 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:07.331823 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:07.342776 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:07.354217 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:07.470711 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:04:07.693385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:08.023449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4687): Launched 01:04:08.311694 run iperf3-srv_10.42.42.10(pid=4688): Launched 01:04:08.436454 tst iperf3.py:8: start network... 01:04:08.658157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:09.167071 run create_hlr_db(pid=4689): Launched 01:04:09.299934 bus /gobi_6: Setting Powered False 01:04:10.363959 run create_hlr_db(pid=4689): Terminated: ok {rc=0} 01:04:10.799935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4691): Launched 01:04:11.106797 run osmo-hlr_10.42.42.2(pid=4692): Launched 01:04:11.224608 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:11.751307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4694): Launched 01:04:12.059358 run osmo-stp_10.42.42.5(pid=4695): Launched 01:04:12.175432 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:12.702322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4697): Launched 01:04:12.822422 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:13.080358 run patchelf(pid=4698): Launched 01:04:13.250603 run osmo-stp_10.42.42.5(pid=4695): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4695)] 01:04:13.380062 run osmo-stp_10.42.42.5(pid=4695): stdout: | (launched: 2022-12-09_01:04:12.002994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:13.511038 run osmo-stp_10.42.42.5(pid=4695): stderr: | 20221209010412174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010412174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010412174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010412174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010412177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010412177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010412177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:13.642274 run osmo-stp_10.42.42.5(pid=4695): stdout: | (launched: 2022-12-09_01:04:12.002994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:13.767320 run osmo-stp_10.42.42.5(pid=4695): stderr: | 20221209010412174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010412174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010412174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010412174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010412177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010412177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010412177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:13.915027 run patchelf(pid=4698): Terminating (SIGINT) 01:04:14.086014 run patchelf(pid=4698): Terminated: ok {rc=0} 01:04:14.209800 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4695): Process ended prematurely: osmo-stp_10.42.42.5(pid=4695) [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4695)] [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 01:04:14.219281 tst iperf3.py:8: Test FAILED (7.6 sec) 01:04:14.247089 run osmo-hlr_10.42.42.2(pid=4692): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4692)] 01:04:14.295551 run osmo-hlr_10.42.42.2(pid=4692): stdout: | (launched: 2022-12-09_01:04:11.050158) 01:04:14.345719 run osmo-hlr_10.42.42.2(pid=4692): stderr: | 20221209010411231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010411231 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010411231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010411231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010411231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010411231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010411243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010411253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010411253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010411253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:14.396395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4687): Terminating (SIGTERM) 01:04:14.436823 run iperf3-srv_10.42.42.10(pid=4688): Terminating (SIGTERM) 01:04:14.477187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4691): Terminating (SIGTERM) 01:04:14.518151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4694): Terminating (SIGTERM) 01:04:14.558435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4697): Terminating (SIGTERM) 01:04:14.598818 --- ParallelTerminationStrategy: PID 4687 died... 01:04:14.618010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4687): Terminated: ok {rc=0} 01:04:14.662680 --- ParallelTerminationStrategy: PID 4688 died... 01:04:14.681688 run iperf3-srv_10.42.42.10(pid=4688): Terminated {rc=256} 01:04:14.726240 --- ParallelTerminationStrategy: PID 4691 died... 01:04:14.744822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4691): Terminated: ok {rc=0} 01:04:14.790012 --- ParallelTerminationStrategy: PID 4694 died... 01:04:14.808506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4694): Terminated: ok {rc=0} 01:04:14.853259 --- ParallelTerminationStrategy: PID 4697 died... 01:04:14.871814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4697): Terminated: ok {rc=0} 01:04:14.958811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:04:16.113650 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:16.126820 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:04:16.181510 tst iperf3m4.py: using LAC 17991 01:04:16.306211 tst iperf3m4.py: using RAC 141 01:04:16.430040 tst iperf3m4.py: using CellId 17991 01:04:16.587454 tst iperf3m4.py: using BVCI 17992 01:04:16.710316 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:16.722827 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:16.734946 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:16.747218 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:16.760103 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:16.773480 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:16.786444 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:16.799212 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:16.811959 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:16.936700 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:17.091580 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:17.247188 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:17.370476 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:04:17.592599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:17.923833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4699): Launched 01:04:18.212033 run iperf3-srv_10.42.42.10(pid=4700): Launched 01:04:18.338855 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:04:18.559428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:18.890265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4701): Launched 01:04:19.175975 run iperf3-srv_10.42.42.10(pid=4702): Launched 01:04:19.300114 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:04:19.521081 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:19.850783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4703): Launched 01:04:20.137960 run iperf3-srv_10.42.42.10(pid=4704): Launched 01:04:20.262253 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:04:20.483145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:20.812855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4705): Launched 01:04:21.100567 run iperf3-srv_10.42.42.10(pid=4706): Launched 01:04:21.223211 tst iperf3m4.py:8: start network... 01:04:21.443438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:21.953564 run create_hlr_db(pid=4707): Launched 01:04:22.088896 bus /gobi_6: Setting Powered False 01:04:23.154351 run create_hlr_db(pid=4707): Terminated: ok {rc=0} 01:04:23.592406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4709): Launched 01:04:23.901462 run osmo-hlr_10.42.42.2(pid=4710): Launched 01:04:24.018924 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:24.562192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4712): Launched 01:04:24.868897 run osmo-stp_10.42.42.5(pid=4713): Launched 01:04:24.985759 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:25.515199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4715): Launched 01:04:25.633645 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:25.894169 run patchelf(pid=4716): Launched 01:04:26.064559 run osmo-stp_10.42.42.5(pid=4713): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4713)] 01:04:26.194557 run osmo-stp_10.42.42.5(pid=4713): stdout: | (launched: 2022-12-09_01:04:24.811908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:26.325651 run osmo-stp_10.42.42.5(pid=4713): stderr: | 20221209010424984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010424984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010424985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010424985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010424987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010424987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010424987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:26.457412 run osmo-stp_10.42.42.5(pid=4713): stdout: | (launched: 2022-12-09_01:04:24.811908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:26.582333 run osmo-stp_10.42.42.5(pid=4713): stderr: | 20221209010424984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010424984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010424985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010424985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010424987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010424987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010424987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:26.730804 run patchelf(pid=4716): Terminating (SIGINT) 01:04:26.902728 run patchelf(pid=4716): Terminated: ok {rc=0} 01:04:27.026533 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4713): Process ended prematurely: osmo-stp_10.42.42.5(pid=4713) [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4713)] [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 01:04:27.035961 tst iperf3m4.py:8: Test FAILED (11.0 sec) 01:04:27.063715 run osmo-hlr_10.42.42.2(pid=4710): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4710)] 01:04:27.111994 run osmo-hlr_10.42.42.2(pid=4710): stdout: | (launched: 2022-12-09_01:04:23.843320) 01:04:27.161974 run osmo-hlr_10.42.42.2(pid=4710): stderr: | 20221209010424023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010424023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010424023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010424023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010424023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010424023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010424036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010424046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010424046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010424046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:27.212138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4699): Terminating (SIGTERM) 01:04:27.252397 run iperf3-srv_10.42.42.10(pid=4700): Terminating (SIGTERM) 01:04:27.292563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4701): Terminating (SIGTERM) 01:04:27.332775 run iperf3-srv_10.42.42.10(pid=4702): Terminating (SIGTERM) 01:04:27.372817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4703): Terminating (SIGTERM) 01:04:27.413419 run iperf3-srv_10.42.42.10(pid=4704): Terminating (SIGTERM) 01:04:27.454831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4705): Terminating (SIGTERM) 01:04:27.496193 run iperf3-srv_10.42.42.10(pid=4706): Terminating (SIGTERM) 01:04:27.538117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4709): Terminating (SIGTERM) 01:04:27.578671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4712): Terminating (SIGTERM) 01:04:27.618990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4715): Terminating (SIGTERM) 01:04:27.659649 --- ParallelTerminationStrategy: PID 4699 died... 01:04:27.678981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4699): Terminated: ok {rc=0} 01:04:27.724285 --- ParallelTerminationStrategy: PID 4700 died... 01:04:27.743194 run iperf3-srv_10.42.42.10(pid=4700): Terminated {rc=256} 01:04:27.788273 --- ParallelTerminationStrategy: PID 4701 died... 01:04:27.807145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4701): Terminated: ok {rc=0} 01:04:27.851865 --- ParallelTerminationStrategy: PID 4702 died... 01:04:27.870715 run iperf3-srv_10.42.42.10(pid=4702): Terminated {rc=256} 01:04:27.915500 --- ParallelTerminationStrategy: PID 4703 died... 01:04:27.934381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4703): Terminated: ok {rc=0} 01:04:27.979304 --- ParallelTerminationStrategy: PID 4704 died... 01:04:27.998079 run iperf3-srv_10.42.42.10(pid=4704): Terminated {rc=256} 01:04:28.042916 --- ParallelTerminationStrategy: PID 4705 died... 01:04:28.061773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4705): Terminated: ok {rc=0} 01:04:28.107195 --- ParallelTerminationStrategy: PID 4706 died... 01:04:28.126053 run iperf3-srv_10.42.42.10(pid=4706): Terminated {rc=256} 01:04:28.170872 --- ParallelTerminationStrategy: PID 4709 died... 01:04:28.189813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4709): Terminated: ok {rc=0} 01:04:28.234820 --- ParallelTerminationStrategy: PID 4712 died... 01:04:28.253781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4712): Terminated: ok {rc=0} 01:04:28.298737 --- ParallelTerminationStrategy: PID 4715 died... 01:04:28.317799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4715): Terminated: ok {rc=0} 01:04:28.404054 bus /gobi_4: Setting Powered False 01:04:29.505237 bus /gobi_4: Setting Powered False 01:04:30.619597 bus /gobi_1: Setting Powered False 01:04:31.716549 bus /gobi_1: Setting Powered False 01:04:32.837863 bus /gobi_0: Setting Powered False 01:04:33.937467 bus /gobi_0: Setting Powered False 01:04:35.055486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 01:04:36.159124 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:36.170559 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:04:36.221361 tst ping.py: using LAC 17992 01:04:36.340220 tst ping.py: using RAC 142 01:04:36.457882 tst ping.py: using CellId 17992 01:04:36.577583 tst ping.py: using BVCI 17993 01:04:36.685918 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:36.696756 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:36.707404 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:36.718010 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:36.728432 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:36.739320 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:36.750113 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:36.761448 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:36.876019 tst ping.py:19: start network... 01:04:37.076169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:37.539547 run create_hlr_db(pid=4717): Launched 01:04:37.653766 bus /gobi_6: Setting Powered False 01:04:38.714121 run create_hlr_db(pid=4717): Terminated: ok {rc=0} 01:04:39.156313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4719): Launched 01:04:39.479855 run osmo-hlr_10.42.42.2(pid=4720): Launched 01:04:39.604633 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:40.168692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4722): Launched 01:04:40.493079 run osmo-stp_10.42.42.5(pid=4723): Launched 01:04:40.616419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:41.173173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4725): Launched 01:04:41.298069 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:41.571290 run patchelf(pid=4726): Launched 01:04:41.752259 run osmo-stp_10.42.42.5(pid=4723): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4723)] 01:04:41.889886 run osmo-stp_10.42.42.5(pid=4723): stdout: | (launched: 2022-12-09_01:04:40.433242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:42.028344 run osmo-stp_10.42.42.5(pid=4723): stderr: | 20221209010440626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010440627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010440627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010440627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010440628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010440628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010440628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:42.166722 run osmo-stp_10.42.42.5(pid=4723): stdout: | (launched: 2022-12-09_01:04:40.433242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:42.298957 run osmo-stp_10.42.42.5(pid=4723): stderr: | 20221209010440626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010440627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010440627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010440627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010440628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010440628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010440628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:42.455484 run patchelf(pid=4726): Terminating (SIGINT) 01:04:42.635930 run patchelf(pid=4726): Terminated: ok {rc=0} 01:04:42.766095 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4723): Process ended prematurely: osmo-stp_10.42.42.5(pid=4723) [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4723)] [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 01:04:42.775721 tst ping.py:22: Test FAILED (6.6 sec) 01:04:42.803923 run osmo-hlr_10.42.42.2(pid=4720): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4720)] 01:04:42.854254 run osmo-hlr_10.42.42.2(pid=4720): stdout: | (launched: 2022-12-09_01:04:39.419888) 01:04:42.906810 run osmo-hlr_10.42.42.2(pid=4720): stderr: | 20221209010439620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010439620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010439621 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010439621 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010439621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010439621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010439633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010439643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010439643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010439643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:42.959530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4719): Terminating (SIGTERM) 01:04:43.001801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4722): Terminating (SIGTERM) 01:04:43.043989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4725): Terminating (SIGTERM) 01:04:43.086565 --- ParallelTerminationStrategy: PID 4719 died... 01:04:43.106331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4719): Terminated: ok {rc=0} 01:04:43.153518 --- ParallelTerminationStrategy: PID 4722 died... 01:04:43.173590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4722): Terminated: ok {rc=0} 01:04:43.219947 --- ParallelTerminationStrategy: PID 4725 died... 01:04:43.239664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4725): Terminated: ok {rc=0} 01:04:43.327756 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:04:44.417276 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:44.429949 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:04:44.483325 tst ping_idle_ping.py: using LAC 17993 01:04:44.612872 tst ping_idle_ping.py: using RAC 143 01:04:44.741385 tst ping_idle_ping.py: using CellId 17993 01:04:44.867458 tst ping_idle_ping.py: using BVCI 17994 01:04:44.984691 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:44.996321 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:45.007698 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:45.019016 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:45.030214 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:45.041478 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:45.052665 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:45.063796 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:45.182640 tst ping_idle_ping.py:24: start network... 01:04:45.401688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:45.922279 run create_hlr_db(pid=4727): Launched 01:04:46.082059 bus /gobi_6: Setting Powered False 01:04:47.141592 run create_hlr_db(pid=4727): Terminated: ok {rc=0} 01:04:47.599530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4729): Launched 01:04:47.923450 run osmo-hlr_10.42.42.2(pid=4730): Launched 01:04:48.047074 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:48.608236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4732): Launched 01:04:48.933043 run osmo-stp_10.42.42.5(pid=4733): Launched 01:04:49.058727 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:49.617285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4735): Launched 01:04:49.741418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:50.016332 run patchelf(pid=4736): Launched 01:04:50.196171 run osmo-stp_10.42.42.5(pid=4733): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4733)] 01:04:50.333730 run osmo-stp_10.42.42.5(pid=4733): stdout: | (launched: 2022-12-09_01:04:48.872491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:50.472545 run osmo-stp_10.42.42.5(pid=4733): stderr: | 20221209010449066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010449066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010449067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010449067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010449069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010449070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010449070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:50.611397 run osmo-stp_10.42.42.5(pid=4733): stdout: | (launched: 2022-12-09_01:04:48.872491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:50.743688 run osmo-stp_10.42.42.5(pid=4733): stderr: | 20221209010449066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010449066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010449067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010449067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010449069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010449070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010449070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:50.901164 run patchelf(pid=4736): Terminating (SIGINT) 01:04:51.082620 run patchelf(pid=4736): Terminated: ok {rc=0} 01:04:51.213297 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4733): Process ended prematurely: osmo-stp_10.42.42.5(pid=4733) [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4733)] [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 01:04:51.222844 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 01:04:51.251397 run osmo-hlr_10.42.42.2(pid=4730): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4730)] 01:04:51.302262 run osmo-hlr_10.42.42.2(pid=4730): stdout: | (launched: 2022-12-09_01:04:47.863305) 01:04:51.355076 run osmo-hlr_10.42.42.2(pid=4730): stderr: | 20221209010448062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010448062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010448062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010448062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010448062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010448062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010448075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010448083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010448084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010448084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:51.408318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4729): Terminating (SIGTERM) 01:04:51.451090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4732): Terminating (SIGTERM) 01:04:51.493851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4735): Terminating (SIGTERM) 01:04:51.536873 --- ParallelTerminationStrategy: PID 4729 died... 01:04:51.557234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4729): Terminated: ok {rc=0} 01:04:51.604420 --- ParallelTerminationStrategy: PID 4732 died... 01:04:51.624331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4732): Terminated: ok {rc=0} 01:04:51.671280 --- ParallelTerminationStrategy: PID 4735 died... 01:04:51.691114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4735): Terminated: ok {rc=0} 01:04:51.779841 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:04:53.086288 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:04:53.092352 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:04:53.125530 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:04:53.163428 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:04:53.249966 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:04:53.282557 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:04:53.320228 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:04:53.912444 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:04:53.962386 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:53.973613 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:04:54.046954 tst cs_paging_gprs_active.py: using LAC 17994 01:04:54.166922 tst cs_paging_gprs_active.py: using RAC 144 01:04:54.286970 tst cs_paging_gprs_active.py: using CellId 17994 01:04:54.407568 tst cs_paging_gprs_active.py: using BVCI 17995 01:04:54.528892 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:54.540381 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:54.551849 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:54.563299 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:54.574581 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:54.585820 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:54.597092 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:54.608186 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:54.619449 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:54.734148 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:54.855205 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:04:55.077510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:55.406952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4740): Launched 01:04:55.693274 run iperf3-srv_10.42.42.10(pid=4741): Launched 01:04:55.816167 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:04:56.037707 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:56.366988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4742): Launched 01:04:56.653912 run iperf3-srv_10.42.42.10(pid=4743): Launched 01:04:56.777435 tst cs_paging_gprs_active.py:38: start network... 01:04:56.998842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:57.507433 run create_hlr_db(pid=4744): Launched 01:04:57.640236 bus /gobi_6: Setting Powered False 01:04:58.705167 run create_hlr_db(pid=4744): Terminated: ok {rc=0} 01:04:59.142700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4746): Launched 01:04:59.448649 run osmo-hlr_10.42.42.2(pid=4747): Launched 01:04:59.567536 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:00.096898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4749): Launched 01:05:00.402645 run osmo-stp_10.42.42.5(pid=4750): Launched 01:05:00.519816 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:01.099308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4752): Launched 01:05:01.233442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:01.515036 run patchelf(pid=4756): Launched 01:05:01.722917 run osmo-stp_10.42.42.5(pid=4750): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4750)] 01:05:01.887693 run osmo-stp_10.42.42.5(pid=4750): stdout: | (launched: 2022-12-09_01:05:00.346214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:02.023462 run osmo-stp_10.42.42.5(pid=4750): stderr: | 20221209010500516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010500516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010500516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010500517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010500517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010500517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010500517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:02.160502 run osmo-stp_10.42.42.5(pid=4750): stdout: | (launched: 2022-12-09_01:05:00.346214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:02.289286 run osmo-stp_10.42.42.5(pid=4750): stderr: | 20221209010500516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010500516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010500516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010500517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010500517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010500517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010500517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:02.437673 run patchelf(pid=4756): Terminating (SIGINT) 01:05:02.609682 run patchelf(pid=4756): Terminated: ok {rc=0} 01:05:02.733693 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4750): Process ended prematurely: osmo-stp_10.42.42.5(pid=4750) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4750)] [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:05:02.743118 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:05:02.771024 run osmo-hlr_10.42.42.2(pid=4747): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4747)] 01:05:02.819893 run osmo-hlr_10.42.42.2(pid=4747): stdout: | (launched: 2022-12-09_01:04:59.392134) 01:05:02.870328 run osmo-hlr_10.42.42.2(pid=4747): stderr: | 20221209010459569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010459569 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010459569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010459569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010459569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010459569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010459580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010459588 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010459588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010459588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:02.921147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4740): Terminating (SIGTERM) 01:05:02.963238 run iperf3-srv_10.42.42.10(pid=4741): Terminating (SIGTERM) 01:05:03.003554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4742): Terminating (SIGTERM) 01:05:03.044028 run iperf3-srv_10.42.42.10(pid=4743): Terminating (SIGTERM) 01:05:03.084268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4746): Terminating (SIGTERM) 01:05:03.124692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4749): Terminating (SIGTERM) 01:05:03.164818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4752): Terminating (SIGTERM) 01:05:03.205442 --- ParallelTerminationStrategy: PID 4740 died... 01:05:03.224545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4740): Terminated: ok {rc=0} 01:05:03.269551 --- ParallelTerminationStrategy: PID 4741 died... 01:05:03.288210 run iperf3-srv_10.42.42.10(pid=4741): Terminated {rc=256} 01:05:03.332666 --- ParallelTerminationStrategy: PID 4742 died... 01:05:03.351367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4742): Terminated: ok {rc=0} 01:05:03.396365 --- ParallelTerminationStrategy: PID 4743 died... 01:05:03.415048 run iperf3-srv_10.42.42.10(pid=4743): Terminated {rc=256} 01:05:03.459523 --- ParallelTerminationStrategy: PID 4746 died... 01:05:03.478310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4746): Terminated: ok {rc=0} 01:05:03.522990 --- ParallelTerminationStrategy: PID 4749 died... 01:05:03.541810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4749): Terminated: ok {rc=0} 01:05:03.586350 --- ParallelTerminationStrategy: PID 4752 died... 01:05:03.605095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4752): Terminated: ok {rc=0} 01:05:03.690971 bus /gobi_0: Setting Powered False 01:05:04.791732 bus /gobi_0: Setting Powered False 01:05:05.908827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:05:07.056364 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:07.067840 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:05:07.139476 tst iperf3.py: using LAC 17995 01:05:07.259352 tst iperf3.py: using RAC 145 01:05:07.379799 tst iperf3.py: using CellId 17995 01:05:07.500032 tst iperf3.py: using BVCI 17996 01:05:07.611914 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:07.622838 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:07.633504 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:07.644278 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:07.655061 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:07.666192 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:07.677164 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:07.687873 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:07.698814 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:07.811417 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:05:08.015640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:08.322314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4757): Launched 01:05:08.588310 run iperf3-srv_10.42.42.10(pid=4758): Launched 01:05:08.702722 tst iperf3.py:8: start network... 01:05:08.906578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:09.377246 run create_hlr_db(pid=4759): Launched 01:05:09.492746 bus /gobi_6: Setting Powered False 01:05:10.553588 run create_hlr_db(pid=4759): Terminated: ok {rc=0} 01:05:10.999289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4761): Launched 01:05:11.326414 run osmo-hlr_10.42.42.2(pid=4762): Launched 01:05:11.451170 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:12.019978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4764): Launched 01:05:12.347112 run osmo-stp_10.42.42.5(pid=4765): Launched 01:05:12.471581 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:13.036327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4767): Launched 01:05:13.161542 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:13.438925 run patchelf(pid=4768): Launched 01:05:13.620711 run osmo-stp_10.42.42.5(pid=4765): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4765)] 01:05:13.759493 run osmo-stp_10.42.42.5(pid=4765): stdout: | (launched: 2022-12-09_01:05:12.287232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:13.900314 run osmo-stp_10.42.42.5(pid=4765): stderr: | 20221209010512480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010512480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010512481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010512481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010512484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010512484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010512484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:14.040650 run osmo-stp_10.42.42.5(pid=4765): stdout: | (launched: 2022-12-09_01:05:12.287232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:14.174946 run osmo-stp_10.42.42.5(pid=4765): stderr: | 20221209010512480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010512480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010512481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010512481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010512484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010512484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010512484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:14.333515 run patchelf(pid=4768): Terminating (SIGINT) 01:05:14.517091 run patchelf(pid=4768): Terminated: ok {rc=0} 01:05:14.649844 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4765): Process ended prematurely: osmo-stp_10.42.42.5(pid=4765) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4765)] [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 01:05:14.659881 tst iperf3.py:8: Test FAILED (7.6 sec) 01:05:14.688833 run osmo-hlr_10.42.42.2(pid=4762): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4762)] 01:05:14.739428 run osmo-hlr_10.42.42.2(pid=4762): stdout: | (launched: 2022-12-09_01:05:11.266026) 01:05:14.791820 run osmo-hlr_10.42.42.2(pid=4762): stderr: | 20221209010511468 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010511468 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010511468 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010511468 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010511468 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010511468 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010511479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010511488 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010511488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010511488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:14.844560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4757): Terminating (SIGTERM) 01:05:14.887342 run iperf3-srv_10.42.42.10(pid=4758): Terminating (SIGTERM) 01:05:14.929820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4761): Terminating (SIGTERM) 01:05:14.972255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4764): Terminating (SIGTERM) 01:05:15.014821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4767): Terminating (SIGTERM) 01:05:15.057324 --- ParallelTerminationStrategy: PID 4757 died... 01:05:15.077685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4757): Terminated: ok {rc=0} 01:05:15.124314 --- ParallelTerminationStrategy: PID 4758 died... 01:05:15.144127 run iperf3-srv_10.42.42.10(pid=4758): Terminated {rc=256} 01:05:15.190730 --- ParallelTerminationStrategy: PID 4761 died... 01:05:15.210506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4761): Terminated: ok {rc=0} 01:05:15.257470 --- ParallelTerminationStrategy: PID 4764 died... 01:05:15.277324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4764): Terminated: ok {rc=0} 01:05:15.323993 --- ParallelTerminationStrategy: PID 4767 died... 01:05:15.343771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4767): Terminated: ok {rc=0} 01:05:15.432678 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:05:16.600010 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:16.616261 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:05:16.693354 tst iperf3m4.py: using LAC 17996 01:05:16.822581 tst iperf3m4.py: using RAC 146 01:05:16.951384 tst iperf3m4.py: using CellId 17996 01:05:17.075088 tst iperf3m4.py: using BVCI 17997 01:05:17.204029 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:17.215909 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:17.227515 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:17.240341 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:17.251795 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:17.263268 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:17.274471 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:17.285909 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:17.297105 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:17.415844 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:17.536914 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:17.654131 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:17.775039 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:05:17.996636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:18.324302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4769): Launched 01:05:18.608885 run iperf3-srv_10.42.42.10(pid=4770): Launched 01:05:18.731567 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:05:18.952129 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:19.279978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4771): Launched 01:05:19.564204 run iperf3-srv_10.42.42.10(pid=4772): Launched 01:05:19.686752 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:05:19.906993 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:20.235050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4773): Launched 01:05:20.518570 run iperf3-srv_10.42.42.10(pid=4774): Launched 01:05:20.641287 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:05:20.860467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:21.187825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4775): Launched 01:05:21.471064 run iperf3-srv_10.42.42.10(pid=4776): Launched 01:05:21.593358 tst iperf3m4.py:8: start network... 01:05:21.812689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:22.319146 run create_hlr_db(pid=4777): Launched 01:05:22.451217 bus /gobi_6: Setting Powered False 01:05:23.515886 run create_hlr_db(pid=4777): Terminated: ok {rc=0} 01:05:23.949140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4779): Launched 01:05:24.253425 run osmo-hlr_10.42.42.2(pid=4780): Launched 01:05:24.369570 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:24.898985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4782): Launched 01:05:25.203120 run osmo-stp_10.42.42.5(pid=4783): Launched 01:05:25.319309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:25.840918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4785): Launched 01:05:25.958080 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:26.214563 run patchelf(pid=4786): Launched 01:05:26.384449 run osmo-stp_10.42.42.5(pid=4783): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4783)] 01:05:26.513839 run osmo-stp_10.42.42.5(pid=4783): stdout: | (launched: 2022-12-09_01:05:25.147112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:26.647907 run osmo-stp_10.42.42.5(pid=4783): stderr: | 20221209010525313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010525313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010525313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010525314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010525314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010525314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010525314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:26.778029 run osmo-stp_10.42.42.5(pid=4783): stdout: | (launched: 2022-12-09_01:05:25.147112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:26.903414 run osmo-stp_10.42.42.5(pid=4783): stderr: | 20221209010525313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010525313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010525313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010525314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010525314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010525314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010525314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:27.050726 run patchelf(pid=4786): Terminating (SIGINT) 01:05:27.221354 run patchelf(pid=4786): Terminated: ok {rc=0} 01:05:27.344874 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4783): Process ended prematurely: osmo-stp_10.42.42.5(pid=4783) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4783)] [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:05:27.354406 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:05:27.382621 run osmo-hlr_10.42.42.2(pid=4780): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4780)] 01:05:27.430776 run osmo-hlr_10.42.42.2(pid=4780): stdout: | (launched: 2022-12-09_01:05:24.197222) 01:05:27.480499 run osmo-hlr_10.42.42.2(pid=4780): stderr: | 20221209010524372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010524372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010524373 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010524373 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010524373 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010524373 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010524384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010524394 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010524394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010524394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:27.532096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4769): Terminating (SIGTERM) 01:05:27.572538 run iperf3-srv_10.42.42.10(pid=4770): Terminating (SIGTERM) 01:05:27.612986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4771): Terminating (SIGTERM) 01:05:27.653436 run iperf3-srv_10.42.42.10(pid=4772): Terminating (SIGTERM) 01:05:27.693561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4773): Terminating (SIGTERM) 01:05:27.733946 run iperf3-srv_10.42.42.10(pid=4774): Terminating (SIGTERM) 01:05:27.774129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4775): Terminating (SIGTERM) 01:05:27.814530 run iperf3-srv_10.42.42.10(pid=4776): Terminating (SIGTERM) 01:05:27.854671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4779): Terminating (SIGTERM) 01:05:27.894813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4782): Terminating (SIGTERM) 01:05:27.934971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4785): Terminating (SIGTERM) 01:05:27.975303 --- ParallelTerminationStrategy: PID 4769 died... 01:05:27.994689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4769): Terminated: ok {rc=0} 01:05:28.039883 --- ParallelTerminationStrategy: PID 4770 died... 01:05:28.058804 run iperf3-srv_10.42.42.10(pid=4770): Terminated {rc=256} 01:05:28.103347 --- ParallelTerminationStrategy: PID 4771 died... 01:05:28.122228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4771): Terminated: ok {rc=0} 01:05:28.166911 --- ParallelTerminationStrategy: PID 4772 died... 01:05:28.185690 run iperf3-srv_10.42.42.10(pid=4772): Terminated {rc=256} 01:05:28.230145 --- ParallelTerminationStrategy: PID 4773 died... 01:05:28.249174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4773): Terminated: ok {rc=0} 01:05:28.294013 --- ParallelTerminationStrategy: PID 4774 died... 01:05:28.313085 run iperf3-srv_10.42.42.10(pid=4774): Terminated {rc=256} 01:05:28.357726 --- ParallelTerminationStrategy: PID 4775 died... 01:05:28.376808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4775): Terminated: ok {rc=0} 01:05:28.421780 --- ParallelTerminationStrategy: PID 4776 died... 01:05:28.440629 run iperf3-srv_10.42.42.10(pid=4776): Terminated {rc=256} 01:05:28.485352 --- ParallelTerminationStrategy: PID 4779 died... 01:05:28.504126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4779): Terminated: ok {rc=0} 01:05:28.548884 --- ParallelTerminationStrategy: PID 4782 died... 01:05:28.567741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4782): Terminated: ok {rc=0} 01:05:28.612561 --- ParallelTerminationStrategy: PID 4785 died... 01:05:28.631453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4785): Terminated: ok {rc=0} 01:05:28.718498 bus /gobi_4: Setting Powered False 01:05:29.817326 bus /gobi_4: Setting Powered False 01:05:30.936401 bus /gobi_1: Setting Powered False 01:05:32.044236 bus /gobi_1: Setting Powered False 01:05:33.161944 bus /gobi_0: Setting Powered False 01:05:34.262307 bus /gobi_0: Setting Powered False 01:05:35.379566 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:05:36.483902 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:36.495969 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:05:36.568533 tst ping.py: using LAC 17997 01:05:36.686325 tst ping.py: using RAC 147 01:05:36.805109 tst ping.py: using CellId 17997 01:05:36.923887 tst ping.py: using BVCI 17998 01:05:37.033057 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:37.043833 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:37.054469 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:37.065288 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:37.075945 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:37.086717 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:37.097795 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:37.108555 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:37.223090 tst ping.py:19: start network... 01:05:37.421960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:37.880528 run create_hlr_db(pid=4787): Launched 01:05:37.994154 bus /gobi_6: Setting Powered False 01:05:39.054139 run create_hlr_db(pid=4787): Terminated: ok {rc=0} 01:05:39.469738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4789): Launched 01:05:39.767283 run osmo-hlr_10.42.42.2(pid=4790): Launched 01:05:39.881594 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:40.410149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4792): Launched 01:05:40.706296 run osmo-stp_10.42.42.5(pid=4793): Launched 01:05:40.819392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:41.330928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4795): Launched 01:05:41.445398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:41.696446 run patchelf(pid=4796): Launched 01:05:41.862565 run osmo-stp_10.42.42.5(pid=4793): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4793)] 01:05:41.989232 run osmo-stp_10.42.42.5(pid=4793): stdout: | (launched: 2022-12-09_01:05:40.652114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:42.117072 run osmo-stp_10.42.42.5(pid=4793): stderr: | 20221209010540820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010540821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010540821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010540821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010540822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010540822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010540822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:42.244884 run osmo-stp_10.42.42.5(pid=4793): stdout: | (launched: 2022-12-09_01:05:40.652114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:42.367227 run osmo-stp_10.42.42.5(pid=4793): stderr: | 20221209010540820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010540821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010540821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010540821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010540822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010540822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010540822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:42.511558 run patchelf(pid=4796): Terminating (SIGINT) 01:05:42.678650 run patchelf(pid=4796): Terminated: ok {rc=0} 01:05:42.799907 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4793): Process ended prematurely: osmo-stp_10.42.42.5(pid=4793) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4793)] [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 01:05:42.808777 tst ping.py:22: Test FAILED (6.3 sec) 01:05:42.835983 run osmo-hlr_10.42.42.2(pid=4790): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4790)] 01:05:42.884218 run osmo-hlr_10.42.42.2(pid=4790): stdout: | (launched: 2022-12-09_01:05:39.712757) 01:05:42.934096 run osmo-hlr_10.42.42.2(pid=4790): stderr: | 20221209010539883 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010539883 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010539883 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010539883 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010539884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010539884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010539896 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010539904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010539905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010539905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:42.984432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4789): Terminating (SIGTERM) 01:05:43.024770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4792): Terminating (SIGTERM) 01:05:43.065038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4795): Terminating (SIGTERM) 01:05:43.105655 --- ParallelTerminationStrategy: PID 4789 died... 01:05:43.124986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4789): Terminated: ok {rc=0} 01:05:43.170137 --- ParallelTerminationStrategy: PID 4792 died... 01:05:43.188824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4792): Terminated: ok {rc=0} 01:05:43.234012 --- ParallelTerminationStrategy: PID 4795 died... 01:05:43.252661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4795): Terminated: ok {rc=0} 01:05:43.339477 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:05:44.431108 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:44.443565 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:05:44.517373 tst ping_idle_ping.py: using LAC 17998 01:05:44.639744 tst ping_idle_ping.py: using RAC 148 01:05:44.757420 tst ping_idle_ping.py: using CellId 17998 01:05:44.872889 tst ping_idle_ping.py: using BVCI 17999 01:05:44.981303 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:44.992147 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:45.002703 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:45.013669 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:45.024385 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:45.035300 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:45.046403 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:45.057239 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:45.174461 tst ping_idle_ping.py:24: start network... 01:05:45.392777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:45.917083 run create_hlr_db(pid=4797): Launched 01:05:46.053587 bus /gobi_6: Setting Powered False 01:05:47.122878 run create_hlr_db(pid=4797): Terminated: ok {rc=0} 01:05:47.570799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4799): Launched 01:05:47.890433 run osmo-hlr_10.42.42.2(pid=4800): Launched 01:05:48.012718 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:48.562614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4802): Launched 01:05:48.882468 run osmo-stp_10.42.42.5(pid=4803): Launched 01:05:49.004498 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:49.554456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4805): Launched 01:05:49.676867 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:49.946929 run patchelf(pid=4806): Launched 01:05:50.125099 run osmo-stp_10.42.42.5(pid=4803): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4803)] 01:05:50.261179 run osmo-stp_10.42.42.5(pid=4803): stdout: | (launched: 2022-12-09_01:05:48.824604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:50.399226 run osmo-stp_10.42.42.5(pid=4803): stderr: | 20221209010549013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010549013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010549013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010549014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010549014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010549014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010549014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:50.537577 run osmo-stp_10.42.42.5(pid=4803): stdout: | (launched: 2022-12-09_01:05:48.824604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:50.669068 run osmo-stp_10.42.42.5(pid=4803): stderr: | 20221209010549013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010549013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010549013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010549014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010549014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010549014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010549014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:50.824411 run patchelf(pid=4806): Terminating (SIGINT) 01:05:51.004092 run patchelf(pid=4806): Terminated: ok {rc=0} 01:05:51.133684 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4803): Process ended prematurely: osmo-stp_10.42.42.5(pid=4803) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4803)] [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:05:51.143336 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:05:51.171331 run osmo-hlr_10.42.42.2(pid=4800): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4800)] 01:05:51.221553 run osmo-hlr_10.42.42.2(pid=4800): stdout: | (launched: 2022-12-09_01:05:47.832473) 01:05:51.273179 run osmo-hlr_10.42.42.2(pid=4800): stderr: | 20221209010548027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010548028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010548028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010548028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010548028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010548028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010548043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010548053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010548054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010548054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:51.325371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4799): Terminating (SIGTERM) 01:05:51.367224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4802): Terminating (SIGTERM) 01:05:51.409142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4805): Terminating (SIGTERM) 01:05:51.451350 --- ParallelTerminationStrategy: PID 4799 died... 01:05:51.471331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4799): Terminated: ok {rc=0} 01:05:51.517853 --- ParallelTerminationStrategy: PID 4802 died... 01:05:51.537632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4802): Terminated: ok {rc=0} 01:05:51.583768 --- ParallelTerminationStrategy: PID 4805 died... 01:05:51.603286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4805): Terminated: ok {rc=0} 01:05:51.689989 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:05:52.995858 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:05:53.002560 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:05:53.036689 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:05:53.076267 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:05:53.166335 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:05:53.200303 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:05:53.239636 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:05:53.828347 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:05:53.877852 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:53.888525 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:05:53.958151 tst cs_paging_gprs_active.py: using LAC 17999 01:05:54.087317 tst cs_paging_gprs_active.py: using RAC 149 01:05:54.216826 tst cs_paging_gprs_active.py: using CellId 17999 01:05:54.345424 tst cs_paging_gprs_active.py: using BVCI 18000 01:05:54.464231 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:54.475767 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:54.487081 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:54.498519 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:54.509704 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:54.520917 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:54.532269 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:54.543449 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:54.554906 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:54.672165 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:54.786295 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:05:54.990306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:55.295150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4811): Launched 01:05:55.562122 run iperf3-srv_10.42.42.10(pid=4812): Launched 01:05:55.676660 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:05:55.880044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:56.185506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4813): Launched 01:05:56.451320 run iperf3-srv_10.42.42.10(pid=4814): Launched 01:05:56.566752 tst cs_paging_gprs_active.py:38: start network... 01:05:56.769719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:57.242377 run create_hlr_db(pid=4815): Launched 01:05:57.359788 bus /gobi_6: Setting Powered False 01:05:58.420912 run create_hlr_db(pid=4815): Terminated: ok {rc=0} 01:05:58.865909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4817): Launched 01:05:59.192343 run osmo-hlr_10.42.42.2(pid=4818): Launched 01:05:59.316902 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:59.880869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4820): Launched 01:06:00.206459 run osmo-stp_10.42.42.5(pid=4821): Launched 01:06:00.330934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:00.932773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4823): Launched 01:06:01.092734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:01.381702 run patchelf(pid=4824): Launched 01:06:01.571734 run osmo-stp_10.42.42.5(pid=4821): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4821)] 01:06:01.714570 run osmo-stp_10.42.42.5(pid=4821): stdout: | (launched: 2022-12-09_01:06:00.147629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:01.859005 run osmo-stp_10.42.42.5(pid=4821): stderr: | 20221209010600335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010600335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010600335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010600336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010600336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010600336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010600336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:02.003798 run osmo-stp_10.42.42.5(pid=4821): stdout: | (launched: 2022-12-09_01:06:00.147629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:02.140130 run osmo-stp_10.42.42.5(pid=4821): stderr: | 20221209010600335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010600335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010600335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010600336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010600336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010600336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010600336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:02.299465 run patchelf(pid=4824): Terminating (SIGINT) 01:06:02.483484 run patchelf(pid=4824): Terminated: ok {rc=0} 01:06:02.617124 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4821): Process ended prematurely: osmo-stp_10.42.42.5(pid=4821) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4821)] [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:06:02.627479 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:06:02.656357 run osmo-hlr_10.42.42.2(pid=4818): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4818)] 01:06:02.706855 run osmo-hlr_10.42.42.2(pid=4818): stdout: | (launched: 2022-12-09_01:05:59.133696) 01:06:02.759006 run osmo-hlr_10.42.42.2(pid=4818): stderr: | 20221209010559331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010559331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010559331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010559331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010559331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010559331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010559343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010559352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010559352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010559352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:02.811445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4811): Terminating (SIGTERM) 01:06:02.853885 run iperf3-srv_10.42.42.10(pid=4812): Terminating (SIGTERM) 01:06:02.895873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4813): Terminating (SIGTERM) 01:06:02.938437 run iperf3-srv_10.42.42.10(pid=4814): Terminating (SIGTERM) 01:06:02.980557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4817): Terminating (SIGTERM) 01:06:03.023176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4820): Terminating (SIGTERM) 01:06:03.065452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4823): Terminating (SIGTERM) 01:06:03.107746 --- ParallelTerminationStrategy: PID 4811 died... 01:06:03.127909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4811): Terminated: ok {rc=0} 01:06:03.174699 --- ParallelTerminationStrategy: PID 4812 died... 01:06:03.194727 run iperf3-srv_10.42.42.10(pid=4812): Terminated {rc=256} 01:06:03.241382 --- ParallelTerminationStrategy: PID 4813 died... 01:06:03.261230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4813): Terminated: ok {rc=0} 01:06:03.307839 --- ParallelTerminationStrategy: PID 4814 died... 01:06:03.327541 run iperf3-srv_10.42.42.10(pid=4814): Terminated {rc=256} 01:06:03.374144 --- ParallelTerminationStrategy: PID 4817 died... 01:06:03.393947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4817): Terminated: ok {rc=0} 01:06:03.440325 --- ParallelTerminationStrategy: PID 4820 died... 01:06:03.459995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4820): Terminated: ok {rc=0} 01:06:03.506448 --- ParallelTerminationStrategy: PID 4823 died... 01:06:03.526099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4823): Terminated: ok {rc=0} 01:06:03.614803 bus /gobi_0: Setting Powered False 01:06:04.711144 bus /gobi_0: Setting Powered False 01:06:05.825781 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:06:06.978017 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:06.990294 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:06:07.065853 tst iperf3.py: using LAC 18000 01:06:07.194950 tst iperf3.py: using RAC 150 01:06:07.323480 tst iperf3.py: using CellId 18000 01:06:07.452274 tst iperf3.py: using BVCI 18001 01:06:07.570048 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:07.581351 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:07.592333 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:07.603491 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:07.614511 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:07.625636 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:07.636724 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:07.647737 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:07.658976 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:07.777886 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:06:07.998089 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:08.323579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4825): Launched 01:06:08.607647 run iperf3-srv_10.42.42.10(pid=4826): Launched 01:06:08.730029 tst iperf3.py:8: start network... 01:06:08.949875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:09.454242 run create_hlr_db(pid=4827): Launched 01:06:09.586390 bus /gobi_6: Setting Powered False 01:06:10.650171 run create_hlr_db(pid=4827): Terminated: ok {rc=0} 01:06:11.101495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4829): Launched 01:06:11.427371 run osmo-hlr_10.42.42.2(pid=4830): Launched 01:06:11.551101 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:12.109201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4832): Launched 01:06:12.432508 run osmo-stp_10.42.42.5(pid=4833): Launched 01:06:12.555639 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:13.114571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4835): Launched 01:06:13.239272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:13.512935 run patchelf(pid=4836): Launched 01:06:13.693702 run osmo-stp_10.42.42.5(pid=4833): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4833)] 01:06:13.831687 run osmo-stp_10.42.42.5(pid=4833): stdout: | (launched: 2022-12-09_01:06:12.374072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:13.971782 run osmo-stp_10.42.42.5(pid=4833): stderr: | 20221209010612564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010612564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010612565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010612565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010612566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010612566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010612566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:14.111341 run osmo-stp_10.42.42.5(pid=4833): stdout: | (launched: 2022-12-09_01:06:12.374072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:14.244560 run osmo-stp_10.42.42.5(pid=4833): stderr: | 20221209010612564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010612564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010612565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010612565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010612566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010612566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010612566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:14.402101 run patchelf(pid=4836): Terminating (SIGINT) 01:06:14.584500 run patchelf(pid=4836): Terminated: ok {rc=0} 01:06:14.716826 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4833): Process ended prematurely: osmo-stp_10.42.42.5(pid=4833) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4833)] [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 01:06:14.726968 tst iperf3.py:8: Test FAILED (7.8 sec) 01:06:14.755768 run osmo-hlr_10.42.42.2(pid=4830): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4830)] 01:06:14.806535 run osmo-hlr_10.42.42.2(pid=4830): stdout: | (launched: 2022-12-09_01:06:11.368553) 01:06:14.859072 run osmo-hlr_10.42.42.2(pid=4830): stderr: | 20221209010611565 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010611565 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010611565 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010611565 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010611566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010611566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010611579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010611587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010611588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010611588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:14.912490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4825): Terminating (SIGTERM) 01:06:14.954973 run iperf3-srv_10.42.42.10(pid=4826): Terminating (SIGTERM) 01:06:14.997526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4829): Terminating (SIGTERM) 01:06:15.039833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4832): Terminating (SIGTERM) 01:06:15.082239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4835): Terminating (SIGTERM) 01:06:15.124942 --- ParallelTerminationStrategy: PID 4825 died... 01:06:15.145155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4825): Terminated: ok {rc=0} 01:06:15.192014 --- ParallelTerminationStrategy: PID 4826 died... 01:06:15.211858 run iperf3-srv_10.42.42.10(pid=4826): Terminated {rc=256} 01:06:15.258451 --- ParallelTerminationStrategy: PID 4829 died... 01:06:15.278217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4829): Terminated: ok {rc=0} 01:06:15.325252 --- ParallelTerminationStrategy: PID 4832 died... 01:06:15.345142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4832): Terminated: ok {rc=0} 01:06:15.391789 --- ParallelTerminationStrategy: PID 4835 died... 01:06:15.411574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4835): Terminated: ok {rc=0} 01:06:15.500013 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:06:16.677631 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:16.693401 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:06:16.783604 tst iperf3m4.py: using LAC 18001 01:06:16.916345 tst iperf3m4.py: using RAC 151 01:06:17.083200 tst iperf3m4.py: using CellId 18001 01:06:17.222299 tst iperf3m4.py: using BVCI 18002 01:06:17.334010 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:17.345034 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:17.355815 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:17.366872 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:17.377749 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:17.388680 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:17.399817 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:17.410861 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:17.422037 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:17.540869 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:17.660889 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:17.779250 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:17.897819 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:06:18.118049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:18.443534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4837): Launched 01:06:18.726194 run iperf3-srv_10.42.42.10(pid=4838): Launched 01:06:18.848811 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:06:19.068648 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:19.394275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4839): Launched 01:06:19.676428 run iperf3-srv_10.42.42.10(pid=4840): Launched 01:06:19.798500 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:06:20.018086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:20.343851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4841): Launched 01:06:20.626272 run iperf3-srv_10.42.42.10(pid=4842): Launched 01:06:20.748595 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:06:20.968024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:21.294013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4843): Launched 01:06:21.576738 run iperf3-srv_10.42.42.10(pid=4844): Launched 01:06:21.698644 tst iperf3m4.py:8: start network... 01:06:21.918276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:22.422010 run create_hlr_db(pid=4845): Launched 01:06:22.553195 bus /gobi_6: Setting Powered False 01:06:23.616934 run create_hlr_db(pid=4845): Terminated: ok {rc=0} 01:06:24.048726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4847): Launched 01:06:24.352776 run osmo-hlr_10.42.42.2(pid=4848): Launched 01:06:24.468426 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:25.005047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4850): Launched 01:06:25.307206 run osmo-stp_10.42.42.5(pid=4851): Launched 01:06:25.422110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:25.941686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4853): Launched 01:06:26.058441 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:26.315280 run patchelf(pid=4854): Launched 01:06:26.486724 run osmo-stp_10.42.42.5(pid=4851): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4851)] 01:06:26.617620 run osmo-stp_10.42.42.5(pid=4851): stdout: | (launched: 2022-12-09_01:06:25.252060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:26.750126 run osmo-stp_10.42.42.5(pid=4851): stderr: | 20221209010625419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010625420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010625420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010625420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010625421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010625421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010625421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:26.882423 run osmo-stp_10.42.42.5(pid=4851): stdout: | (launched: 2022-12-09_01:06:25.252060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:27.008607 run osmo-stp_10.42.42.5(pid=4851): stderr: | 20221209010625419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010625420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010625420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010625420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010625421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010625421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010625421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:27.158042 run patchelf(pid=4854): Terminating (SIGINT) 01:06:27.330689 run patchelf(pid=4854): Terminated: ok {rc=0} 01:06:27.455560 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4851): Process ended prematurely: osmo-stp_10.42.42.5(pid=4851) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4851)] [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:06:27.465416 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:06:27.493920 run osmo-hlr_10.42.42.2(pid=4848): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4848)] 01:06:27.542409 run osmo-hlr_10.42.42.2(pid=4848): stdout: | (launched: 2022-12-09_01:06:24.297158) 01:06:27.592608 run osmo-hlr_10.42.42.2(pid=4848): stderr: | 20221209010624471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010624471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010624471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010624471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010624472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010624472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010624483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010624493 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010624493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010624493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:27.643390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4837): Terminating (SIGTERM) 01:06:27.683972 run iperf3-srv_10.42.42.10(pid=4838): Terminating (SIGTERM) 01:06:27.724439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4839): Terminating (SIGTERM) 01:06:27.765449 run iperf3-srv_10.42.42.10(pid=4840): Terminating (SIGTERM) 01:06:27.806107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4841): Terminating (SIGTERM) 01:06:27.846728 run iperf3-srv_10.42.42.10(pid=4842): Terminating (SIGTERM) 01:06:27.887057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4843): Terminating (SIGTERM) 01:06:27.927678 run iperf3-srv_10.42.42.10(pid=4844): Terminating (SIGTERM) 01:06:27.967960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4847): Terminating (SIGTERM) 01:06:28.008563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4850): Terminating (SIGTERM) 01:06:28.049096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4853): Terminating (SIGTERM) 01:06:28.090394 --- ParallelTerminationStrategy: PID 4837 died... 01:06:28.109802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4837): Terminated: ok {rc=0} 01:06:28.154947 --- ParallelTerminationStrategy: PID 4838 died... 01:06:28.174067 run iperf3-srv_10.42.42.10(pid=4838): Terminated {rc=256} 01:06:28.218938 --- ParallelTerminationStrategy: PID 4839 died... 01:06:28.237760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4839): Terminated: ok {rc=0} 01:06:28.282747 --- ParallelTerminationStrategy: PID 4840 died... 01:06:28.301463 run iperf3-srv_10.42.42.10(pid=4840): Terminated {rc=256} 01:06:28.346211 --- ParallelTerminationStrategy: PID 4841 died... 01:06:28.365104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4841): Terminated: ok {rc=0} 01:06:28.410106 --- ParallelTerminationStrategy: PID 4842 died... 01:06:28.428831 run iperf3-srv_10.42.42.10(pid=4842): Terminated {rc=256} 01:06:28.473661 --- ParallelTerminationStrategy: PID 4843 died... 01:06:28.492479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4843): Terminated: ok {rc=0} 01:06:28.537387 --- ParallelTerminationStrategy: PID 4844 died... 01:06:28.556253 run iperf3-srv_10.42.42.10(pid=4844): Terminated {rc=256} 01:06:28.601114 --- ParallelTerminationStrategy: PID 4847 died... 01:06:28.619960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4847): Terminated: ok {rc=0} 01:06:28.665042 --- ParallelTerminationStrategy: PID 4850 died... 01:06:28.683978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4850): Terminated: ok {rc=0} 01:06:28.729625 --- ParallelTerminationStrategy: PID 4853 died... 01:06:28.748547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4853): Terminated: ok {rc=0} 01:06:28.834985 bus /gobi_4: Setting Powered False 01:06:29.936601 bus /gobi_4: Setting Powered False 01:06:31.054300 bus /gobi_1: Setting Powered False 01:06:32.159005 bus /gobi_1: Setting Powered False 01:06:33.277308 bus /gobi_0: Setting Powered False 01:06:34.377504 bus /gobi_0: Setting Powered False 01:06:35.495229 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:06:36.601771 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:36.613920 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:06:36.685712 tst ping.py: using LAC 18002 01:06:36.811577 tst ping.py: using RAC 152 01:06:36.939474 tst ping.py: using CellId 18002 01:06:37.065050 tst ping.py: using BVCI 18003 01:06:37.182769 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:37.194461 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:37.205896 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:37.217599 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:37.229114 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:37.240579 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:37.252203 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:37.263693 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:37.382606 tst ping.py:19: start network... 01:06:37.600037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:38.098144 run create_hlr_db(pid=4855): Launched 01:06:38.228744 bus /gobi_6: Setting Powered False 01:06:39.291579 run create_hlr_db(pid=4855): Terminated: ok {rc=0} 01:06:39.723735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4857): Launched 01:06:40.027019 run osmo-hlr_10.42.42.2(pid=4858): Launched 01:06:40.143457 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:40.683653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4860): Launched 01:06:40.987115 run osmo-stp_10.42.42.5(pid=4861): Launched 01:06:41.103145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:41.623165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4863): Launched 01:06:41.738108 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:41.991739 run patchelf(pid=4864): Launched 01:06:42.161285 run osmo-stp_10.42.42.5(pid=4861): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4861)] 01:06:42.288857 run osmo-stp_10.42.42.5(pid=4861): stdout: | (launched: 2022-12-09_01:06:40.931589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:42.418570 run osmo-stp_10.42.42.5(pid=4861): stderr: | 20221209010641098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010641098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010641099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010641099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010641099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010641099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010641100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:42.548819 run osmo-stp_10.42.42.5(pid=4861): stdout: | (launched: 2022-12-09_01:06:40.931589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:42.672532 run osmo-stp_10.42.42.5(pid=4861): stderr: | 20221209010641098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010641098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010641099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010641099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010641099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010641099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010641100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:42.819451 run patchelf(pid=4864): Terminating (SIGINT) 01:06:42.989624 run patchelf(pid=4864): Terminated: ok {rc=0} 01:06:43.111876 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4861): Process ended prematurely: osmo-stp_10.42.42.5(pid=4861) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4861)] [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 01:06:43.120898 tst ping.py:22: Test FAILED (6.5 sec) 01:06:43.147734 run osmo-hlr_10.42.42.2(pid=4858): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4858)] 01:06:43.195430 run osmo-hlr_10.42.42.2(pid=4858): stdout: | (launched: 2022-12-09_01:06:39.971688) 01:06:43.245909 run osmo-hlr_10.42.42.2(pid=4858): stderr: | 20221209010640144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010640144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010640144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010640144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010640144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010640145 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010640157 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010640165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010640165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010640165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:43.296482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4857): Terminating (SIGTERM) 01:06:43.336693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4860): Terminating (SIGTERM) 01:06:43.376929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4863): Terminating (SIGTERM) 01:06:43.417334 --- ParallelTerminationStrategy: PID 4857 died... 01:06:43.436547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4857): Terminated: ok {rc=0} 01:06:43.481227 --- ParallelTerminationStrategy: PID 4860 died... 01:06:43.499746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4860): Terminated: ok {rc=0} 01:06:43.543846 --- ParallelTerminationStrategy: PID 4863 died... 01:06:43.562450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4863): Terminated: ok {rc=0} 01:06:43.647996 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:06:44.738226 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:44.750193 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:06:44.822813 tst ping_idle_ping.py: using LAC 18003 01:06:44.950669 tst ping_idle_ping.py: using RAC 153 01:06:45.078571 tst ping_idle_ping.py: using CellId 18003 01:06:45.206607 tst ping_idle_ping.py: using BVCI 18004 01:06:45.325813 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:45.337255 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:45.348564 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:45.359716 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:45.370802 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:45.381949 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:45.393258 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:45.404356 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:45.518820 tst ping_idle_ping.py:24: start network... 01:06:45.722965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:46.249342 run create_hlr_db(pid=4866): Launched 01:06:46.405258 bus /gobi_6: Setting Powered False 01:06:47.465360 run create_hlr_db(pid=4866): Terminated: ok {rc=0} 01:06:47.908760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4868): Launched 01:06:48.233712 run osmo-hlr_10.42.42.2(pid=4869): Launched 01:06:48.357993 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:48.915680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4871): Launched 01:06:49.240388 run osmo-stp_10.42.42.5(pid=4872): Launched 01:06:49.364682 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:49.924296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4874): Launched 01:06:50.048581 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:50.321189 run patchelf(pid=4875): Launched 01:06:50.501293 run osmo-stp_10.42.42.5(pid=4872): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4872)] 01:06:50.638810 run osmo-stp_10.42.42.5(pid=4872): stdout: | (launched: 2022-12-09_01:06:49.181598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:50.778032 run osmo-stp_10.42.42.5(pid=4872): stderr: | 20221209010649374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010649374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010649375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010649375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010649375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010649376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010649376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:50.917705 run osmo-stp_10.42.42.5(pid=4872): stdout: | (launched: 2022-12-09_01:06:49.181598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:51.051190 run osmo-stp_10.42.42.5(pid=4872): stderr: | 20221209010649374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010649374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010649375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010649375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010649375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010649376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010649376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:51.208564 run patchelf(pid=4875): Terminating (SIGINT) 01:06:51.389990 run patchelf(pid=4875): Terminated: ok {rc=0} 01:06:51.520691 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4872): Process ended prematurely: osmo-stp_10.42.42.5(pid=4872) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4872)] [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:06:51.530517 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 01:06:51.558959 run osmo-hlr_10.42.42.2(pid=4869): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4869)] 01:06:51.609691 run osmo-hlr_10.42.42.2(pid=4869): stdout: | (launched: 2022-12-09_01:06:48.174670) 01:06:51.662215 run osmo-hlr_10.42.42.2(pid=4869): stderr: | 20221209010648372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010648372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010648372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010648372 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010648372 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010648372 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010648388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010648396 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010648397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010648397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:51.715068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4868): Terminating (SIGTERM) 01:06:51.757495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4871): Terminating (SIGTERM) 01:06:51.799849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4874): Terminating (SIGTERM) 01:06:51.842828 --- ParallelTerminationStrategy: PID 4868 died... 01:06:51.863027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4868): Terminated: ok {rc=0} 01:06:51.910383 --- ParallelTerminationStrategy: PID 4871 died... 01:06:51.930598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4871): Terminated: ok {rc=0} 01:06:51.977284 --- ParallelTerminationStrategy: PID 4874 died... 01:06:51.997104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4874): Terminated: ok {rc=0} 01:06:52.085150 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:06:53.396196 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:06:53.404151 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:06:53.438440 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 01:06:53.476403 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 01:06:53.562652 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:06:53.595380 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 01:06:53.633158 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 01:06:54.230789 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 01:06:54.280846 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.292076 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:06:54.343925 tst cs_paging_gprs_active.py: using LAC 18004 01:06:54.475221 tst cs_paging_gprs_active.py: using RAC 154 01:06:54.597387 tst cs_paging_gprs_active.py: using CellId 18004 01:06:54.717622 tst cs_paging_gprs_active.py: using BVCI 18005 01:06:54.829455 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.840546 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.851549 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.862847 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.874170 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.885415 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.896598 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.907806 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.919005 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:55.040866 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:55.162255 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:06:55.386177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:55.717954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4879): Launched 01:06:56.007363 run iperf3-srv_10.42.42.10(pid=4880): Launched 01:06:56.131921 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:06:56.355282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:56.687153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4881): Launched 01:06:56.976206 run iperf3-srv_10.42.42.10(pid=4882): Launched 01:06:57.100621 tst cs_paging_gprs_active.py:38: start network... 01:06:57.323835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:57.835515 run create_hlr_db(pid=4883): Launched 01:06:57.969825 bus /gobi_6: Setting Powered False 01:06:59.035550 run create_hlr_db(pid=4883): Terminated: ok {rc=0} 01:06:59.475134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4885): Launched 01:06:59.784236 run osmo-hlr_10.42.42.2(pid=4886): Launched 01:06:59.902994 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:00.446488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4888): Launched 01:07:00.777551 run osmo-stp_10.42.42.5(pid=4889): Launched 01:07:00.947693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:01.647821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4891): Launched 01:07:01.787160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:02.071097 run patchelf(pid=4892): Launched 01:07:02.270483 run osmo-stp_10.42.42.5(pid=4889): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4889)] 01:07:02.411942 run osmo-stp_10.42.42.5(pid=4889): stdout: | (launched: 2022-12-09_01:07:00.717651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:02.552844 run osmo-stp_10.42.42.5(pid=4889): stderr: | 20221209010701053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010701053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010701053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010701054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010701054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010701054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010701055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:02.694541 run osmo-stp_10.42.42.5(pid=4889): stdout: | (launched: 2022-12-09_01:07:00.717651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:02.829411 run osmo-stp_10.42.42.5(pid=4889): stderr: | 20221209010701053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010701053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010701053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010701054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010701054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010701054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010701055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:02.990234 run patchelf(pid=4892): Terminating (SIGINT) 01:07:03.175603 run patchelf(pid=4892): Terminated: ok {rc=0} 01:07:03.308581 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4889): Process ended prematurely: osmo-stp_10.42.42.5(pid=4889) [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4889)] [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 01:07:03.319107 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 01:07:03.348158 run osmo-hlr_10.42.42.2(pid=4886): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4886)] 01:07:03.399188 run osmo-hlr_10.42.42.2(pid=4886): stdout: | (launched: 2022-12-09_01:06:59.728020) 01:07:03.452067 run osmo-hlr_10.42.42.2(pid=4886): stderr: | 20221209010659904 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010659904 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010659904 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010659904 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010659904 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010659904 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010659916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010659924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010659924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010659924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:03.505471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4879): Terminating (SIGTERM) 01:07:03.548019 run iperf3-srv_10.42.42.10(pid=4880): Terminating (SIGTERM) 01:07:03.590390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4881): Terminating (SIGTERM) 01:07:03.632757 run iperf3-srv_10.42.42.10(pid=4882): Terminating (SIGTERM) 01:07:03.675267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4885): Terminating (SIGTERM) 01:07:03.717741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4888): Terminating (SIGTERM) 01:07:03.759920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4891): Terminating (SIGTERM) 01:07:03.802583 --- ParallelTerminationStrategy: PID 4879 died... 01:07:03.822778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4879): Terminated: ok {rc=0} 01:07:03.869594 --- ParallelTerminationStrategy: PID 4880 died... 01:07:03.889360 run iperf3-srv_10.42.42.10(pid=4880): Terminated {rc=256} 01:07:03.936377 --- ParallelTerminationStrategy: PID 4881 died... 01:07:03.956113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4881): Terminated: ok {rc=0} 01:07:04.002894 --- ParallelTerminationStrategy: PID 4882 died... 01:07:04.022517 run iperf3-srv_10.42.42.10(pid=4882): Terminated {rc=256} 01:07:04.069134 --- ParallelTerminationStrategy: PID 4885 died... 01:07:04.088939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4885): Terminated: ok {rc=0} 01:07:04.135586 --- ParallelTerminationStrategy: PID 4888 died... 01:07:04.155483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4888): Terminated: ok {rc=0} 01:07:04.202142 --- ParallelTerminationStrategy: PID 4891 died... 01:07:04.222001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4891): Terminated: ok {rc=0} 01:07:04.310762 bus /gobi_0: Setting Powered False 01:07:05.412526 bus /gobi_0: Setting Powered False 01:07:06.529654 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 01:07:07.679951 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:07.692572 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:07:07.750447 tst iperf3.py: using LAC 18005 01:07:07.880407 tst iperf3.py: using RAC 155 01:07:08.009162 tst iperf3.py: using CellId 18005 01:07:08.139146 tst iperf3.py: using BVCI 18006 01:07:08.260170 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:08.271902 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:08.283437 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:08.294957 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:08.306406 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:08.318054 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:08.329749 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:08.341779 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:08.353799 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:08.470143 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:07:08.676551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:07:08.985626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4893): Launched 01:07:09.255646 run iperf3-srv_10.42.42.10(pid=4894): Launched 01:07:09.370917 tst iperf3.py:8: start network... 01:07:09.576486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:10.052570 run create_hlr_db(pid=4895): Launched 01:07:10.171004 bus /gobi_6: Setting Powered False 01:07:11.231982 run create_hlr_db(pid=4895): Terminated: ok {rc=0} 01:07:11.679772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4897): Launched 01:07:12.010333 run osmo-hlr_10.42.42.2(pid=4898): Launched 01:07:12.136297 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:12.706518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4900): Launched 01:07:13.037461 run osmo-stp_10.42.42.5(pid=4901): Launched 01:07:13.165163 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:13.735215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4903): Launched 01:07:13.861739 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:14.140212 run patchelf(pid=4904): Launched 01:07:14.323648 run osmo-stp_10.42.42.5(pid=4901): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4901)] 01:07:14.463612 run osmo-stp_10.42.42.5(pid=4901): stdout: | (launched: 2022-12-09_01:07:12.977408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:14.605024 run osmo-stp_10.42.42.5(pid=4901): stderr: | 20221209010713168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010713169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010713169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010713169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010713170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010713170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010713170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:14.746442 run osmo-stp_10.42.42.5(pid=4901): stdout: | (launched: 2022-12-09_01:07:12.977408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:14.881327 run osmo-stp_10.42.42.5(pid=4901): stderr: | 20221209010713168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010713169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010713169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010713169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010713170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010713170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010713170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:15.041577 run patchelf(pid=4904): Terminating (SIGINT) 01:07:15.226929 run patchelf(pid=4904): Terminated: ok {rc=0} 01:07:15.359833 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4901): Process ended prematurely: osmo-stp_10.42.42.5(pid=4901) [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4901)] [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 01:07:15.370000 tst iperf3.py:8: Test FAILED (7.7 sec) 01:07:15.398918 run osmo-hlr_10.42.42.2(pid=4898): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4898)] 01:07:15.449562 run osmo-hlr_10.42.42.2(pid=4898): stdout: | (launched: 2022-12-09_01:07:11.950434) 01:07:15.501811 run osmo-hlr_10.42.42.2(pid=4898): stderr: | 20221209010712148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010712148 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010712148 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010712148 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010712148 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010712148 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010712160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010712171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010712171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010712171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:15.554543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4893): Terminating (SIGTERM) 01:07:15.596893 run iperf3-srv_10.42.42.10(pid=4894): Terminating (SIGTERM) 01:07:15.639032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4897): Terminating (SIGTERM) 01:07:15.681367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4900): Terminating (SIGTERM) 01:07:15.723494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4903): Terminating (SIGTERM) 01:07:15.765905 --- ParallelTerminationStrategy: PID 4893 died... 01:07:15.786306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4893): Terminated: ok {rc=0} 01:07:15.833251 --- ParallelTerminationStrategy: PID 4894 died... 01:07:15.854688 run iperf3-srv_10.42.42.10(pid=4894): Terminated {rc=256} 01:07:15.907554 --- ParallelTerminationStrategy: PID 4897 died... 01:07:15.932347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4897): Terminated: ok {rc=0} 01:07:15.980074 --- ParallelTerminationStrategy: PID 4900 died... 01:07:16.000572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4900): Terminated: ok {rc=0} 01:07:16.047889 --- ParallelTerminationStrategy: PID 4903 died... 01:07:16.068273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4903): Terminated: ok {rc=0} 01:07:16.158046 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 01:07:17.319558 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:17.332248 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:07:17.384906 tst iperf3m4.py: using LAC 18006 01:07:17.512607 tst iperf3m4.py: using RAC 156 01:07:17.639698 tst iperf3m4.py: using CellId 18006 01:07:17.768654 tst iperf3m4.py: using BVCI 18007 01:07:17.888016 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:17.899872 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:17.911550 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:17.923210 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:17.934950 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:17.947058 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:17.958881 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:17.970483 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:17.982194 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:18.103637 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:18.224471 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:18.347424 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:18.467267 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:07:18.675738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:07:18.985715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4905): Launched 01:07:19.255492 run iperf3-srv_10.42.42.10(pid=4906): Launched 01:07:19.371670 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:07:19.578459 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:07:19.887127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4907): Launched 01:07:20.155738 run iperf3-srv_10.42.42.10(pid=4908): Launched 01:07:20.271390 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:07:20.477725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:07:20.785802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4909): Launched 01:07:21.054156 run iperf3-srv_10.42.42.10(pid=4910): Launched 01:07:21.170153 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:07:21.375794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:07:21.684479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4911): Launched 01:07:21.953118 run iperf3-srv_10.42.42.10(pid=4912): Launched 01:07:22.068616 tst iperf3m4.py:8: start network... 01:07:22.274552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:22.749448 run create_hlr_db(pid=4913): Launched 01:07:22.867620 bus /gobi_6: Setting Powered False 01:07:23.927997 run create_hlr_db(pid=4913): Terminated: ok {rc=0} 01:07:24.377405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4915): Launched 01:07:24.707911 run osmo-hlr_10.42.42.2(pid=4916): Launched 01:07:24.833506 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:25.406959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4918): Launched 01:07:25.735179 run osmo-stp_10.42.42.5(pid=4919): Launched 01:07:25.859661 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:26.401660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4921): Launched 01:07:26.519892 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:26.780456 run patchelf(pid=4922): Launched 01:07:26.951573 run osmo-stp_10.42.42.5(pid=4919): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4919)] 01:07:27.082006 run osmo-stp_10.42.42.5(pid=4919): stdout: | (launched: 2022-12-09_01:07:25.675316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:27.214468 run osmo-stp_10.42.42.5(pid=4919): stderr: | 20221209010725864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010725864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010725864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010725865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010725865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010725865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010725865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:27.346076 run osmo-stp_10.42.42.5(pid=4919): stdout: | (launched: 2022-12-09_01:07:25.675316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:27.471461 run osmo-stp_10.42.42.5(pid=4919): stderr: | 20221209010725864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010725864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010725864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010725865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010725865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010725865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010725865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:27.620355 run patchelf(pid=4922): Terminating (SIGINT) 01:07:27.793207 run patchelf(pid=4922): Terminated: ok {rc=0} 01:07:27.917717 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4919): Process ended prematurely: osmo-stp_10.42.42.5(pid=4919) [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4919)] [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 01:07:27.927360 tst iperf3m4.py:8: Test FAILED (10.6 sec) 01:07:27.955759 run osmo-hlr_10.42.42.2(pid=4916): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4916)] 01:07:28.004065 run osmo-hlr_10.42.42.2(pid=4916): stdout: | (launched: 2022-12-09_01:07:24.647630) 01:07:28.054142 run osmo-hlr_10.42.42.2(pid=4916): stderr: | 20221209010724843 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010724844 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010724844 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010724844 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010724844 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010724844 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010724856 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010724865 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010724865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010724865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:28.104380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4905): Terminating (SIGTERM) 01:07:28.144515 run iperf3-srv_10.42.42.10(pid=4906): Terminating (SIGTERM) 01:07:28.184585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4907): Terminating (SIGTERM) 01:07:28.225018 run iperf3-srv_10.42.42.10(pid=4908): Terminating (SIGTERM) 01:07:28.265061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4909): Terminating (SIGTERM) 01:07:28.305350 run iperf3-srv_10.42.42.10(pid=4910): Terminating (SIGTERM) 01:07:28.345443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4911): Terminating (SIGTERM) 01:07:28.385461 run iperf3-srv_10.42.42.10(pid=4912): Terminating (SIGTERM) 01:07:28.425631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4915): Terminating (SIGTERM) 01:07:28.465790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4918): Terminating (SIGTERM) 01:07:28.505931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4921): Terminating (SIGTERM) 01:07:28.546380 --- ParallelTerminationStrategy: PID 4905 died... 01:07:28.565582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4905): Terminated: ok {rc=0} 01:07:28.610415 --- ParallelTerminationStrategy: PID 4906 died... 01:07:28.629101 run iperf3-srv_10.42.42.10(pid=4906): Terminated {rc=256} 01:07:28.673857 --- ParallelTerminationStrategy: PID 4907 died... 01:07:28.692729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4907): Terminated: ok {rc=0} 01:07:28.737329 --- ParallelTerminationStrategy: PID 4908 died... 01:07:28.755873 run iperf3-srv_10.42.42.10(pid=4908): Terminated {rc=256} 01:07:28.800472 --- ParallelTerminationStrategy: PID 4909 died... 01:07:28.819306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4909): Terminated: ok {rc=0} 01:07:28.864008 --- ParallelTerminationStrategy: PID 4910 died... 01:07:28.882771 run iperf3-srv_10.42.42.10(pid=4910): Terminated {rc=256} 01:07:28.927133 --- ParallelTerminationStrategy: PID 4911 died... 01:07:28.945976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4911): Terminated: ok {rc=0} 01:07:28.990418 --- ParallelTerminationStrategy: PID 4912 died... 01:07:29.009126 run iperf3-srv_10.42.42.10(pid=4912): Terminated {rc=256} 01:07:29.053552 --- ParallelTerminationStrategy: PID 4915 died... 01:07:29.072438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4915): Terminated: ok {rc=0} 01:07:29.117213 --- ParallelTerminationStrategy: PID 4918 died... 01:07:29.135667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4918): Terminated: ok {rc=0} 01:07:29.180361 --- ParallelTerminationStrategy: PID 4921 died... 01:07:29.199441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4921): Terminated: ok {rc=0} 01:07:29.286936 bus /gobi_4: Setting Powered False 01:07:30.387817 bus /gobi_4: Setting Powered False 01:07:31.511574 bus /gobi_1: Setting Powered False 01:07:32.616884 bus /gobi_1: Setting Powered False 01:07:33.733462 bus /gobi_0: Setting Powered False 01:07:34.830212 bus /gobi_0: Setting Powered False 01:07:35.947026 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 01:07:37.052558 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:37.065041 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:07:37.119363 tst ping.py: using LAC 18007 01:07:37.245607 tst ping.py: using RAC 157 01:07:37.372896 tst ping.py: using CellId 18007 01:07:37.501982 tst ping.py: using BVCI 18008 01:07:37.620909 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:37.632811 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:37.644416 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:37.656142 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:37.667627 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:37.679194 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:37.690912 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:37.702428 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:37.818512 tst ping.py:19: start network... 01:07:38.021071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:38.486151 run create_hlr_db(pid=4923): Launched 01:07:38.602893 bus /gobi_6: Setting Powered False 01:07:39.663327 run create_hlr_db(pid=4923): Terminated: ok {rc=0} 01:07:40.083848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4925): Launched 01:07:40.385519 run osmo-hlr_10.42.42.2(pid=4926): Launched 01:07:40.501739 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:41.039300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4928): Launched 01:07:41.341706 run osmo-stp_10.42.42.5(pid=4929): Launched 01:07:41.457864 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:41.980365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4931): Launched 01:07:42.096068 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:42.351381 run patchelf(pid=4932): Launched 01:07:42.520219 run osmo-stp_10.42.42.5(pid=4929): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4929)] 01:07:42.648541 run osmo-stp_10.42.42.5(pid=4929): stdout: | (launched: 2022-12-09_01:07:41.285795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:42.778515 run osmo-stp_10.42.42.5(pid=4929): stderr: | 20221209010741455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010741455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010741455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010741456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010741456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010741456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010741457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:42.908428 run osmo-stp_10.42.42.5(pid=4929): stdout: | (launched: 2022-12-09_01:07:41.285795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:43.032381 run osmo-stp_10.42.42.5(pid=4929): stderr: | 20221209010741455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010741455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010741455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010741456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010741456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010741456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010741457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:43.179298 run patchelf(pid=4932): Terminating (SIGINT) 01:07:43.349498 run patchelf(pid=4932): Terminated: ok {rc=0} 01:07:43.472089 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4929): Process ended prematurely: osmo-stp_10.42.42.5(pid=4929) [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4929)] [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 01:07:43.481220 tst ping.py:22: Test FAILED (6.4 sec) 01:07:43.508581 run osmo-hlr_10.42.42.2(pid=4926): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4926)] 01:07:43.557105 run osmo-hlr_10.42.42.2(pid=4926): stdout: | (launched: 2022-12-09_01:07:40.329850) 01:07:43.607197 run osmo-hlr_10.42.42.2(pid=4926): stderr: | 20221209010740504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010740504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010740504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010740504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010740504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010740504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010740516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010740524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010740525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010740525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:43.657917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4925): Terminating (SIGTERM) 01:07:43.698148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4928): Terminating (SIGTERM) 01:07:43.738627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4931): Terminating (SIGTERM) 01:07:43.779281 --- ParallelTerminationStrategy: PID 4925 died... 01:07:43.798487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4925): Terminated: ok {rc=0} 01:07:43.844563 --- ParallelTerminationStrategy: PID 4928 died... 01:07:43.863435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4928): Terminated: ok {rc=0} 01:07:43.908021 --- ParallelTerminationStrategy: PID 4931 died... 01:07:43.926766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4931): Terminated: ok {rc=0} 01:07:44.014396 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 01:07:45.101766 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:45.113764 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:07:45.167424 tst ping_idle_ping.py: using LAC 18008 01:07:45.286338 tst ping_idle_ping.py: using RAC 158 01:07:45.404788 tst ping_idle_ping.py: using CellId 18008 01:07:45.522918 tst ping_idle_ping.py: using BVCI 18009 01:07:45.634180 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:45.645600 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:45.656535 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:45.667856 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:45.679078 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:45.690415 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:45.701784 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:45.713115 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:45.838662 tst ping_idle_ping.py:24: start network... 01:07:46.047913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:46.530759 run create_hlr_db(pid=4934): Launched 01:07:46.684152 bus /gobi_6: Setting Powered False 01:07:47.745174 run create_hlr_db(pid=4934): Terminated: ok {rc=0} 01:07:48.189098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4936): Launched 01:07:48.514046 run osmo-hlr_10.42.42.2(pid=4937): Launched 01:07:48.639008 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:49.204714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4939): Launched 01:07:49.529993 run osmo-stp_10.42.42.5(pid=4940): Launched 01:07:49.654155 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:50.214177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4942): Launched 01:07:50.339035 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:50.613112 run patchelf(pid=4943): Launched 01:07:50.793714 run osmo-stp_10.42.42.5(pid=4940): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4940)] 01:07:50.931492 run osmo-stp_10.42.42.5(pid=4940): stdout: | (launched: 2022-12-09_01:07:49.470950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:51.071686 run osmo-stp_10.42.42.5(pid=4940): stderr: | 20221209010749663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010749663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010749664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010749664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010749665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010749665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010749665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:51.211007 run osmo-stp_10.42.42.5(pid=4940): stdout: | (launched: 2022-12-09_01:07:49.470950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:51.343816 run osmo-stp_10.42.42.5(pid=4940): stderr: | 20221209010749663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010749663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010749664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010749664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010749665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010749665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010749665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:51.502009 run patchelf(pid=4943): Terminating (SIGINT) 01:07:51.683944 run patchelf(pid=4943): Terminated: ok {rc=0} 01:07:51.815090 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4940): Process ended prematurely: osmo-stp_10.42.42.5(pid=4940) [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4940)] [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 01:07:51.825064 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:07:51.853590 run osmo-hlr_10.42.42.2(pid=4937): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4937)] 01:07:51.904195 run osmo-hlr_10.42.42.2(pid=4937): stdout: | (launched: 2022-12-09_01:07:48.455207) 01:07:51.957205 run osmo-hlr_10.42.42.2(pid=4937): stderr: | 20221209010748653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010748653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010748653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010748653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010748653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010748653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010748666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010748675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010748675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010748675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:52.009889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4936): Terminating (SIGTERM) 01:07:52.052061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4939): Terminating (SIGTERM) 01:07:52.094345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4942): Terminating (SIGTERM) 01:07:52.136737 --- ParallelTerminationStrategy: PID 4936 died... 01:07:52.157034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4936): Terminated: ok {rc=0} 01:07:52.203871 --- ParallelTerminationStrategy: PID 4939 died... 01:07:52.223832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4939): Terminated: ok {rc=0} 01:07:52.270486 --- ParallelTerminationStrategy: PID 4942 died... 01:07:52.290280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4942): Terminated: ok {rc=0} 01:07:52.378986 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:07:53.693338 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:07:53.701137 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:07:53.735548 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:07:53.770953 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:07:53.825231 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:07:53.859128 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:07:53.894321 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:07:54.453077 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:07:54.458232 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:54.469876 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:07:54.541002 tst switch_tch_pdch.py: using LAC 18009 01:07:54.666992 tst switch_tch_pdch.py: using RAC 159 01:07:54.795496 tst switch_tch_pdch.py: using CellId 18009 01:07:54.922589 tst switch_tch_pdch.py: using BVCI 18010 01:07:55.040079 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:55.051915 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:55.063364 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:55.074939 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:55.086575 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:55.098135 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:55.109739 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:55.121228 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:07:55.239696 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:07:55.355358 tst switch_tch_pdch.py:51: start network... 01:07:55.559387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:56.025151 run create_hlr_db(pid=4947): Launched 01:07:56.141132 bus /gobi_6: Setting Powered False 01:07:57.201627 run create_hlr_db(pid=4947): Terminated: ok {rc=0} 01:07:57.644768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4949): Launched 01:07:57.968138 run osmo-hlr_10.42.42.2(pid=4950): Launched 01:07:58.092585 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:58.649163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4952): Launched 01:07:58.972729 run osmo-stp_10.42.42.5(pid=4953): Launched 01:07:59.096890 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:59.655116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4955): Launched 01:07:59.778868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:08:00.052250 run patchelf(pid=4956): Launched 01:08:00.231847 run osmo-stp_10.42.42.5(pid=4953): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4953)] 01:08:00.369166 run osmo-stp_10.42.42.5(pid=4953): stdout: | (launched: 2022-12-09_01:07:58.913474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:00.507786 run osmo-stp_10.42.42.5(pid=4953): stderr: | 20221209010759106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010759106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010759107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010759107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010759107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010759108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010759108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:00.646704 run osmo-stp_10.42.42.5(pid=4953): stdout: | (launched: 2022-12-09_01:07:58.913474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:00.779351 run osmo-stp_10.42.42.5(pid=4953): stderr: | 20221209010759106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010759106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010759107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010759107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010759107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010759108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010759108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:00.961842 run patchelf(pid=4956): Terminating (SIGINT) 01:08:01.138225 run patchelf(pid=4956): Terminated: ok {rc=0} 01:08:01.274667 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4953): Process ended prematurely: osmo-stp_10.42.42.5(pid=4953) [trial-2352↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4953)] [trial-2352↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:08:01.284801 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 01:08:01.327689 run osmo-hlr_10.42.42.2(pid=4950): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4950)] 01:08:01.399313 run osmo-hlr_10.42.42.2(pid=4950): stdout: | (launched: 2022-12-09_01:07:57.908863) 01:08:01.463799 run osmo-hlr_10.42.42.2(pid=4950): stderr: | 20221209010758106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010758107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010758107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010758107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010758107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010758107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010758119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010758127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010758127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010758127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:01.537712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4949): Terminating (SIGTERM) 01:08:01.604654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4952): Terminating (SIGTERM) 01:08:01.661794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4955): Terminating (SIGTERM) 01:08:01.721023 --- ParallelTerminationStrategy: PID 4949 died... 01:08:01.750325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4949): Terminated: ok {rc=0} 01:08:01.815632 --- ParallelTerminationStrategy: PID 4952 died... 01:08:01.844629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4952): Terminated: ok {rc=0} 01:08:01.908138 --- ParallelTerminationStrategy: PID 4955 died... 01:08:01.928333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4955): Terminated: ok {rc=0} 01:08:02.050802 bus /gobi_0: Setting Powered False 01:08:03.190006 bus /gobi_0: Setting Powered False 01:08:04.323847 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:08:05.589671 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:05.596730 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:08:05.632577 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:08:05.668934 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:08:05.724287 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:08:05.759273 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:08:05.796488 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:08:06.351928 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:08:06.358834 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:08:06.371127 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:08:06.442123 tst switch_tch_pdch.py: using LAC 18010 01:08:06.581929 tst switch_tch_pdch.py: using RAC 160 01:08:06.713541 tst switch_tch_pdch.py: using CellId 18010 01:08:06.842468 tst switch_tch_pdch.py: using BVCI 18011 01:08:06.964146 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:08:06.977831 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:08:06.990317 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:08:07.002318 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:08:07.014402 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:08:07.026503 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:08:07.038663 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:08:07.050494 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:08:07.173579 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:08:07.297720 tst switch_tch_pdch.py:51: start network... 01:08:07.521072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:08.004866 run create_hlr_db(pid=5231): Launched 01:08:08.172732 bus /gobi_6: Setting Powered False 01:08:09.240441 run create_hlr_db(pid=5231): Terminated: ok {rc=0} 01:08:09.676124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5233): Launched 01:08:10.023444 run osmo-hlr_10.42.42.2(pid=5234): Launched 01:08:10.274793 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:10.910144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5236): Launched 01:08:11.255469 run osmo-stp_10.42.42.5(pid=5237): Launched 01:08:11.502051 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:08:12.122611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5239): Launched 01:08:12.260133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:08:12.539282 run patchelf(pid=5240): Launched 01:08:12.737943 run osmo-stp_10.42.42.5(pid=5237): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5237)] 01:08:12.879367 run osmo-stp_10.42.42.5(pid=5237): stdout: | (launched: 2022-12-09_01:08:11.194613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:13.023761 run osmo-stp_10.42.42.5(pid=5237): stderr: | 20221209010811491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010811491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010811492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010811492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010811492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010811493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010811493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:13.165443 run osmo-stp_10.42.42.5(pid=5237): stdout: | (launched: 2022-12-09_01:08:11.194613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:13.322525 run osmo-stp_10.42.42.5(pid=5237): stderr: | 20221209010811491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010811491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010811492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010811492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010811492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010811493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010811493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:13.483792 run patchelf(pid=5240): Terminating (SIGINT) 01:08:13.672154 run patchelf(pid=5240): Terminated: ok {rc=0} 01:08:13.809394 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5237): Process ended prematurely: osmo-stp_10.42.42.5(pid=5237) [trial-2352↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5237)] [trial-2352↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:08:13.820190 tst switch_tch_pdch.py:54: Test FAILED (7.5 sec) 01:08:13.850389 run osmo-hlr_10.42.42.2(pid=5234): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5234)] 01:08:13.902767 run osmo-hlr_10.42.42.2(pid=5234): stdout: | (launched: 2022-12-09_01:08:09.962789) 01:08:13.956422 run osmo-hlr_10.42.42.2(pid=5234): stderr: | 20221209010810270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010810270 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010810270 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010810270 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010810270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010810270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010810290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010810303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010810303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010810303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:14.012202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5233): Terminating (SIGTERM) 01:08:14.056083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5236): Terminating (SIGTERM) 01:08:14.101610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5239): Terminating (SIGTERM) 01:08:14.147339 --- ParallelTerminationStrategy: PID 5233 died... 01:08:14.168098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5233): Terminated: ok {rc=0} 01:08:14.218519 --- ParallelTerminationStrategy: PID 5236 died... 01:08:14.239144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5236): Terminated: ok {rc=0} 01:08:14.287079 --- ParallelTerminationStrategy: PID 5239 died... 01:08:14.307403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5239): Terminated: ok {rc=0} 01:08:14.398516 bus /gobi_0: Setting Powered False 01:08:15.503151 bus /gobi_0: Setting Powered False 01:08:16.660366 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 01:08:17.951950 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:17.956688 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:08:17.995715 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 01:08:18.003448 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 01:08:18.057361 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:08:18.093359 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 01:08:18.101120 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 01:08:18.640317 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 01:08:18.647960 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 01:08:18.660723 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:08:18.714835 tst mo_mt_sms.py: using LAC 18011 01:08:18.836778 tst mo_mt_sms.py: using RAC 161 01:08:18.960146 tst mo_mt_sms.py: using CellId 18011 01:08:19.082337 tst mo_mt_sms.py: using BVCI 18012 01:08:19.198863 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:08:19.318993 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:08:19.439446 tst mo_mt_sms.py:9: start nitb and bts... 01:08:19.654642 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:08:20.293706 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5244): Launched 01:08:20.621980 run osmo-nitb_10.42.42.2(pid=5245): Launched 01:08:20.817305 run osmo-nitb_10.42.42.2(pid=5245): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5245)] 01:08:20.960100 run osmo-nitb_10.42.42.2(pid=5245): stdout: | (launched: 2022-12-09_01:08:20.563106) 01:08:21.103228 run osmo-nitb_10.42.42.2(pid=5245): stderr: | (launched: 2022-12-09_01:08:20.611132) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:08:21.247885 run osmo-nitb_10.42.42.2(pid=5245): stdout: | (launched: 2022-12-09_01:08:20.563106) 01:08:21.386451 run osmo-nitb_10.42.42.2(pid=5245): stderr: | (launched: 2022-12-09_01:08:20.611132) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5245): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5245) [trial-2352↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5245)] 01:08:21.761553 tst osmo-nitb_10.42.42.2(pid=5245): stdout: | (launched: 2022-12-09_01:08:20.563106) 01:08:21.890751 tst osmo-nitb_10.42.42.2(pid=5245): stderr: | (launched: 2022-12-09_01:08:20.611132) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:08:22.042427 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=5245): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5245) [trial-2352↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5245)] [trial-2352↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 01:08:22.051828 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 01:08:22.059966 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5244): Terminating (SIGTERM) 01:08:22.274381 --- ParallelTerminationStrategy: PID 5244 died... 01:08:22.296435 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5244): Terminated: ok {rc=0} 01:08:22.389094 bus /sierra_3: Setting Powered False 01:08:23.491434 bus /sierra_3: Setting Powered False 01:08:24.610962 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 sms:trx-sysmocell5000 --------------------------------------------------------------------- 01:08:25.810489 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:25.814880 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:08:25.848546 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:08:25.875449 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 01:08:25.930331 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:08:25.964064 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:08:25.990331 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 01:08:26.535833 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 01:08:26.541084 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:26.552066 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:08:26.600481 tst mo_mt_sms.py: using LAC 18012 01:08:26.730396 tst mo_mt_sms.py: using RAC 162 01:08:26.859410 tst mo_mt_sms.py: using CellId 18012 01:08:26.988333 tst mo_mt_sms.py: using BVCI 18013 01:08:27.107343 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:27.118746 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:27.129945 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:27.140871 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:27.151894 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:27.162827 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:08:27.278884 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:08:27.397025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:27.898013 run create_hlr_db(pid=5250): Launched 01:08:28.032144 bus /sierra_2: Setting Powered False 01:08:29.093412 run create_hlr_db(pid=5250): Terminated: ok {rc=0} 01:08:29.525408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5252): Launched 01:08:29.828384 run osmo-hlr_10.42.42.2(pid=5253): Launched 01:08:29.942853 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:30.474564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5255): Launched 01:08:30.775916 run osmo-stp_10.42.42.5(pid=5256): Launched 01:08:30.985596 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:31.663901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5258): Launched 01:08:32.010423 run osmo-msc_10.42.42.6(pid=5259): Launched 01:08:32.300388 run osmo-stp_10.42.42.5(pid=5256): ERR: Terminated: ERROR {rc=1} [trial-2352↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5256)] 01:08:32.460562 run osmo-stp_10.42.42.5(pid=5256): stdout: | (launched: 2022-12-09_01:08:30.720464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:32.588023 run osmo-stp_10.42.42.5(pid=5256): stderr: | 20221209010830951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010830952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010830952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010830952 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010830960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010830960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010830960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:32.713743 run osmo-stp_10.42.42.5(pid=5256): stdout: | (launched: 2022-12-09_01:08:30.720464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:32.833567 run osmo-stp_10.42.42.5(pid=5256): stderr: | 20221209010830951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010830952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010830952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010830952 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010830960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010830960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010830960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:32.976909 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5256): Process ended prematurely: osmo-stp_10.42.42.5(pid=5256) [trial-2352↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5256)] [trial-2352↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 01:08:32.985458 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 01:08:33.012626 run osmo-hlr_10.42.42.2(pid=5253): ERR: Terminated: ERROR {rc=237} [trial-2352↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5253)] 01:08:33.061898 run osmo-hlr_10.42.42.2(pid=5253): stdout: | (launched: 2022-12-09_01:08:29.772919) 01:08:33.112433 run osmo-hlr_10.42.42.2(pid=5253): stderr: | 20221209010829954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010829954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010829954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010829955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010829955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010829955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010829968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010829977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010829977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010829978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:33.182864 run osmo-msc_10.42.42.6(pid=5259): ERR: Terminated: ERROR {rc=2} [trial-2352↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5259)] 01:08:33.231657 run osmo-msc_10.42.42.6(pid=5259): stdout: | (launched: 2022-12-09_01:08:31.947419) 01:08:33.281712 run osmo-msc_10.42.42.6(pid=5259): stderr: | 20221209010832412 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010832412 DLGLOBAL DEBUG validating counter group 0x7faa04e2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010832412 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010832413 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010832413 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010832413 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010832415 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010832415 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010832415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010832415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:33.332339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5252): Terminating (SIGTERM) 01:08:33.372565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5255): Terminating (SIGTERM) 01:08:33.412597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5258): Terminating (SIGTERM) 01:08:33.453024 --- ParallelTerminationStrategy: PID 5252 died... 01:08:33.472272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5252): Terminated: ok {rc=0} 01:08:33.517235 --- ParallelTerminationStrategy: PID 5255 died... 01:08:33.536022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5255): Terminated: ok {rc=0} 01:08:33.581132 --- ParallelTerminationStrategy: PID 5258 died... 01:08:33.600020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5258): Terminated: ok {rc=0} 01:08:33.685774 bus /sierra_3: Setting Powered False 01:08:34.785716 bus /sierra_3: Setting Powered False 01:08:35.905193 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 01:08:37.140730 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:37.144917 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:08:37.180253 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 01:08:37.187510 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 01:08:37.224071 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:08:37.259499 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 01:08:37.266628 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 01:08:37.786953 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2352 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 01:08:37.792321 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 01:08:37.803806 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:08:37.857107 tst assert_extension.py: using LAC 18013 01:08:37.985057 tst assert_extension.py: using RAC 163 01:08:38.105617 tst assert_extension.py: using CellId 18013 01:08:38.230286 tst assert_extension.py: using BVCI 18014 01:08:38.340647 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 01:08:38.454584 tst assert_extension.py:10: start nitb and bts... 01:08:38.656119 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:08:39.272454 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5264): Launched 01:08:39.575659 run osmo-nitb_10.42.42.2(pid=5265): Launched 01:08:39.743702 run osmo-nitb_10.42.42.2(pid=5265): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5265)] 01:08:39.880205 run osmo-nitb_10.42.42.2(pid=5265): stdout: | (launched: 2022-12-09_01:08:39.520201) 01:08:40.018142 run osmo-nitb_10.42.42.2(pid=5265): stderr: | (launched: 2022-12-09_01:08:39.565364) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:08:40.155669 run osmo-nitb_10.42.42.2(pid=5265): stdout: | (launched: 2022-12-09_01:08:39.520201) 01:08:40.287474 run osmo-nitb_10.42.42.2(pid=5265): stderr: | (launched: 2022-12-09_01:08:39.565364) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5265): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5265) [trial-2352↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5265)] 01:08:40.690192 tst osmo-nitb_10.42.42.2(pid=5265): stdout: | (launched: 2022-12-09_01:08:39.520201) 01:08:40.813414 tst osmo-nitb_10.42.42.2(pid=5265): stderr: | (launched: 2022-12-09_01:08:39.565364) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:08:40.958197 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5265): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5265) [trial-2352↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5265)] [trial-2352↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 01:08:40.966704 tst assert_extension.py:12: Test FAILED (3.2 sec) 01:08:40.973502 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5264): Terminating (SIGTERM) 01:08:41.183609 --- ParallelTerminationStrategy: PID 5264 died... 01:08:41.204592 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5264): Terminated: ok {rc=0} 01:08:41.292635 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 01:08:42.471205 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:42.475030 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:08:42.509470 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:08:42.535854 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 01:08:42.571891 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:08:42.607915 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:08:42.635751 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 01:08:43.167083 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2352 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 01:08:43.172424 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:43.183841 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:08:43.238602 tst assert_extension.py: using LAC 18014 01:08:43.364744 tst assert_extension.py: using RAC 164 01:08:43.489792 tst assert_extension.py: using CellId 18014 01:08:43.617914 tst assert_extension.py: using BVCI 18015 01:08:43.736194 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:43.747506 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:43.758595 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:43.769660 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:43.780664 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:43.791927 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 01:08:43.907651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:44.376046 run create_hlr_db(pid=5270): Launched 01:08:44.492687 bus /sierra_2: Setting Powered False 01:08:45.553465 run create_hlr_db(pid=5270): Terminated: ok {rc=0} 01:08:46.027253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5272): Launched 01:08:46.377753 run osmo-hlr_10.42.42.2(pid=5273): Launched 01:08:46.517967 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:47.316073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5275): Launched 01:08:47.643342 run osmo-stp_10.42.42.5(pid=5276): Launched 01:08:47.764440 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:48.339448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5278): Launched 01:08:48.656862 run osmo-msc_10.42.42.6(pid=5279): Launched 01:08:48.836377 run osmo-stp_10.42.42.5(pid=5276): ERR: Terminated: ERROR {rc=1} [trial-2352↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5276)] 01:08:48.971425 run osmo-stp_10.42.42.5(pid=5276): stdout: | (launched: 2022-12-09_01:08:47.585134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:49.107537 run osmo-stp_10.42.42.5(pid=5276): stderr: | 20221209010847776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010847776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010847776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010847777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010847778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010847778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010847778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:49.241706 run osmo-stp_10.42.42.5(pid=5276): stdout: | (launched: 2022-12-09_01:08:47.585134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:49.368506 run osmo-stp_10.42.42.5(pid=5276): stderr: | 20221209010847776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010847776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010847776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010847777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010847778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010847778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010847778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:49.520074 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5276): Process ended prematurely: osmo-stp_10.42.42.5(pid=5276) [trial-2352↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5276)] [trial-2352↪ussd:trx-sysmocell5000↪assert_extension.py:17] 01:08:49.529138 tst assert_extension.py:17: Test FAILED (6.3 sec) 01:08:49.556716 run osmo-hlr_10.42.42.2(pid=5273): ERR: Terminated: ERROR {rc=237} [trial-2352↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5273)] 01:08:49.607587 run osmo-hlr_10.42.42.2(pid=5273): stdout: | (launched: 2022-12-09_01:08:46.311977) 01:08:49.659886 run osmo-hlr_10.42.42.2(pid=5273): stderr: | 20221209010846656 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010846656 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010846656 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010846657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010846658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010846659 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010846687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010846711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010846711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010846712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:49.732802 run osmo-msc_10.42.42.6(pid=5279): ERR: Terminated: ERROR {rc=2} [trial-2352↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5279)] 01:08:49.783212 run osmo-msc_10.42.42.6(pid=5279): stdout: | (launched: 2022-12-09_01:08:48.599182) 01:08:49.835502 run osmo-msc_10.42.42.6(pid=5279): stderr: | 20221209010848920 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010848921 DLGLOBAL DEBUG validating counter group 0x7fde0e0e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010848921 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010848921 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010848921 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010848921 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010848923 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010848923 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010848923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010848923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:49.888449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5272): Terminating (SIGTERM) 01:08:49.930560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5275): Terminating (SIGTERM) 01:08:49.972577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5278): Terminating (SIGTERM) 01:08:50.015203 --- ParallelTerminationStrategy: PID 5272 died... 01:08:50.035626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5272): Terminated: ok {rc=0} 01:08:50.082168 --- ParallelTerminationStrategy: PID 5275 died... 01:08:50.101819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5275): Terminated: ok {rc=0} 01:08:50.147954 --- ParallelTerminationStrategy: PID 5278 died... 01:08:50.167482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5278): Terminated: ok {rc=0} 01:08:50.255291 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:08:51.472016 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:51.479669 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:08:51.514497 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:08:51.541815 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:08:51.594432 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:08:51.628753 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:08:51.656027 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:08:52.209694 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:08:52.262231 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:52.273937 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:08:52.345751 tst mo_mt_call.py: using LAC 18015 01:08:52.473876 tst mo_mt_call.py: using RAC 165 01:08:52.602363 tst mo_mt_call.py: using CellId 18015 01:08:52.729001 tst mo_mt_call.py: using BVCI 18016 01:08:52.846058 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:52.857742 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:52.869205 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:52.880625 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:52.892222 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:52.903718 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:08:53.020474 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:08:53.139540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:53.641412 run create_hlr_db(pid=5284): Launched 01:08:53.774407 bus /sierra_2: Setting Powered False 01:08:54.838739 run create_hlr_db(pid=5284): Terminated: ok {rc=0} 01:08:55.273199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5287): Launched 01:08:55.577779 run osmo-hlr_10.42.42.2(pid=5288): Launched 01:08:55.694549 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:56.233146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5290): Launched 01:08:56.537151 run osmo-stp_10.42.42.5(pid=5291): Launched 01:08:56.652871 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:57.201695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5293): Launched 01:08:57.506758 run osmo-msc_10.42.42.6(pid=5294): Launched 01:08:57.677874 run osmo-stp_10.42.42.5(pid=5291): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5291)] 01:08:57.807280 run osmo-stp_10.42.42.5(pid=5291): stdout: | (launched: 2022-12-09_01:08:56.481331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:57.936573 run osmo-stp_10.42.42.5(pid=5291): stderr: | 20221209010856653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010856653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010856653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010856654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010856654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010856654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010856654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:58.063484 run osmo-stp_10.42.42.5(pid=5291): stdout: | (launched: 2022-12-09_01:08:56.481331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:58.183880 run osmo-stp_10.42.42.5(pid=5291): stderr: | 20221209010856653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010856653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010856653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010856654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010856654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010856654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010856654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:58.328792 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5291): Process ended prematurely: osmo-stp_10.42.42.5(pid=5291) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5291)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:08:58.337871 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:08:58.365106 run osmo-hlr_10.42.42.2(pid=5288): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5288)] 01:08:58.413576 run osmo-hlr_10.42.42.2(pid=5288): stdout: | (launched: 2022-12-09_01:08:55.522514) 01:08:58.463751 run osmo-hlr_10.42.42.2(pid=5288): stderr: | 20221209010855699 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010855699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010855699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010855699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010855699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010855699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010855711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010855722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010855722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010855722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:58.533617 run osmo-msc_10.42.42.6(pid=5294): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5294)] 01:08:58.582187 run osmo-msc_10.42.42.6(pid=5294): stdout: | (launched: 2022-12-09_01:08:57.451253) 01:08:58.632199 run osmo-msc_10.42.42.6(pid=5294): stderr: | 20221209010857724 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010857724 DLGLOBAL DEBUG validating counter group 0x7f10cb0b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010857725 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010857725 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010857725 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010857725 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010857727 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010857727 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010857727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010857727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:58.682651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5287): Terminating (SIGTERM) 01:08:58.722856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5290): Terminating (SIGTERM) 01:08:58.763010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5293): Terminating (SIGTERM) 01:08:58.803426 --- ParallelTerminationStrategy: PID 5287 died... 01:08:58.822535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5287): Terminated: ok {rc=0} 01:08:58.866957 --- ParallelTerminationStrategy: PID 5290 died... 01:08:58.885479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5290): Terminated: ok {rc=0} 01:08:58.929702 --- ParallelTerminationStrategy: PID 5293 died... 01:08:58.948257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5293): Terminated: ok {rc=0} 01:08:59.035421 bus /sierra_3: Setting Powered False 01:09:00.135440 bus /sierra_3: Setting Powered False 01:09:01.261251 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:09:02.410013 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:09:02.421730 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:09:02.491657 tst mo_mt_call_osmux.py: using LAC 18016 01:09:02.615546 tst mo_mt_call_osmux.py: using RAC 166 01:09:02.743615 tst mo_mt_call_osmux.py: using CellId 18016 01:09:02.863891 tst mo_mt_call_osmux.py: using BVCI 18017 01:09:02.973970 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:09:02.988931 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:09:03.001099 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:09:03.013465 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:09:03.025622 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:09:03.037820 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:09:03.156055 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:09:03.276552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:03.780568 run create_hlr_db(pid=5296): Launched 01:09:03.912625 bus /sierra_2: Setting Powered False 01:09:04.976875 run create_hlr_db(pid=5296): Terminated: ok {rc=0} 01:09:05.412192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5298): Launched 01:09:05.717053 run osmo-hlr_10.42.42.2(pid=5299): Launched 01:09:05.833961 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:06.395986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5301): Launched 01:09:06.720725 run osmo-stp_10.42.42.5(pid=5302): Launched 01:09:06.843988 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:07.430439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5304): Launched 01:09:07.756756 run osmo-msc_10.42.42.6(pid=5305): Launched 01:09:07.939201 run osmo-stp_10.42.42.5(pid=5302): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5302)] 01:09:08.077787 run osmo-stp_10.42.42.5(pid=5302): stdout: | (launched: 2022-12-09_01:09:06.661382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:08.215228 run osmo-stp_10.42.42.5(pid=5302): stderr: | 20221209010906855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010906855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010906855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010906855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010906856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010906856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010906856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:08.351865 run osmo-stp_10.42.42.5(pid=5302): stdout: | (launched: 2022-12-09_01:09:06.661382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:08.481352 run osmo-stp_10.42.42.5(pid=5302): stderr: | 20221209010906855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010906855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010906855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010906855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010906856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010906856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010906856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:08.636393 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5302): Process ended prematurely: osmo-stp_10.42.42.5(pid=5302) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5302)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:09:08.646216 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:09:08.673930 run osmo-hlr_10.42.42.2(pid=5299): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5299)] 01:09:08.724280 run osmo-hlr_10.42.42.2(pid=5299): stdout: | (launched: 2022-12-09_01:09:05.661719) 01:09:08.776244 run osmo-hlr_10.42.42.2(pid=5299): stderr: | 20221209010905836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010905836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010905836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010905836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010905836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010905837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010905848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010905857 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010905857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010905857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:08.848696 run osmo-msc_10.42.42.6(pid=5305): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5305)] 01:09:08.898647 run osmo-msc_10.42.42.6(pid=5305): stdout: | (launched: 2022-12-09_01:09:07.697866) 01:09:08.950371 run osmo-msc_10.42.42.6(pid=5305): stderr: | 20221209010908022 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010908022 DLGLOBAL DEBUG validating counter group 0x7fa523191c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010908022 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010908022 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010908023 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010908023 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010908024 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010908025 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010908025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010908025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:09.002876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5298): Terminating (SIGTERM) 01:09:09.044882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5301): Terminating (SIGTERM) 01:09:09.086785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5304): Terminating (SIGTERM) 01:09:09.129014 --- ParallelTerminationStrategy: PID 5298 died... 01:09:09.149178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5298): Terminated: ok {rc=0} 01:09:09.195451 --- ParallelTerminationStrategy: PID 5301 died... 01:09:09.215012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5301): Terminated: ok {rc=0} 01:09:09.261114 --- ParallelTerminationStrategy: PID 5304 died... 01:09:09.280420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5304): Terminated: ok {rc=0} 01:09:09.367172 bus /sierra_3: Setting Powered False 01:09:10.465524 bus /sierra_3: Setting Powered False 01:09:11.581665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:09:12.838786 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:09:12.845890 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:09:12.880444 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:09:12.907721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:09:12.961220 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:09:12.995994 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:09:13.023226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:09:13.576145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:09:13.628173 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:13.639800 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:09:13.711154 tst mo_mt_call.py: using LAC 18017 01:09:13.837672 tst mo_mt_call.py: using RAC 167 01:09:13.964550 tst mo_mt_call.py: using CellId 18017 01:09:14.094475 tst mo_mt_call.py: using BVCI 18018 01:09:14.211868 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:14.223471 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:14.234953 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:14.246522 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:14.258257 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:14.269719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:09:14.386668 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:09:14.505447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:15.008428 run create_hlr_db(pid=5310): Launched 01:09:15.142014 bus /sierra_2: Setting Powered False 01:09:16.208232 run create_hlr_db(pid=5310): Terminated: ok {rc=0} 01:09:16.671111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5312): Launched 01:09:17.010492 run osmo-hlr_10.42.42.2(pid=5313): Launched 01:09:17.210225 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:17.732111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5315): Launched 01:09:18.038245 run osmo-stp_10.42.42.5(pid=5316): Launched 01:09:18.154892 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:18.711425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5318): Launched 01:09:19.016933 run osmo-msc_10.42.42.6(pid=5319): Launched 01:09:19.188251 run osmo-stp_10.42.42.5(pid=5316): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5316)] 01:09:19.317677 run osmo-stp_10.42.42.5(pid=5316): stdout: | (launched: 2022-12-09_01:09:17.982006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:19.446923 run osmo-stp_10.42.42.5(pid=5316): stderr: | 20221209010918152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010918153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010918153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010918153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010918154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010918154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010918154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:19.573901 run osmo-stp_10.42.42.5(pid=5316): stdout: | (launched: 2022-12-09_01:09:17.982006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:19.695257 run osmo-stp_10.42.42.5(pid=5316): stderr: | 20221209010918152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010918153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010918153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010918153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010918154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010918154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010918154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:19.840763 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5316): Process ended prematurely: osmo-stp_10.42.42.5(pid=5316) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5316)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:09:19.849821 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:09:19.877011 run osmo-hlr_10.42.42.2(pid=5313): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5313)] 01:09:19.925432 run osmo-hlr_10.42.42.2(pid=5313): stdout: | (launched: 2022-12-09_01:09:16.951348) 01:09:19.975618 run osmo-hlr_10.42.42.2(pid=5313): stderr: | 20221209010917148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010917149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010917149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010917149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010917149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010917149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010917161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010917169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010917169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010917169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:20.045833 run osmo-msc_10.42.42.6(pid=5319): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5319)] 01:09:20.094797 run osmo-msc_10.42.42.6(pid=5319): stdout: | (launched: 2022-12-09_01:09:18.961323) 01:09:20.145253 run osmo-msc_10.42.42.6(pid=5319): stderr: | 20221209010919233 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010919233 DLGLOBAL DEBUG validating counter group 0x7fb24c1eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010919233 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010919233 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010919234 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010919234 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010919235 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010919236 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010919236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010919236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:20.196157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5312): Terminating (SIGTERM) 01:09:20.236405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5315): Terminating (SIGTERM) 01:09:20.276622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5318): Terminating (SIGTERM) 01:09:20.317291 --- ParallelTerminationStrategy: PID 5312 died... 01:09:20.336449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5312): Terminated: ok {rc=0} 01:09:20.381294 --- ParallelTerminationStrategy: PID 5315 died... 01:09:20.399890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5315): Terminated: ok {rc=0} 01:09:20.444813 --- ParallelTerminationStrategy: PID 5318 died... 01:09:20.463915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5318): Terminated: ok {rc=0} 01:09:20.550099 bus /sierra_3: Setting Powered False 01:09:21.650715 bus /sierra_3: Setting Powered False 01:09:22.768540 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:09:23.915817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:23.927739 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:09:23.998509 tst mo_mt_call_osmux.py: using LAC 18018 01:09:24.118856 tst mo_mt_call_osmux.py: using RAC 168 01:09:24.243457 tst mo_mt_call_osmux.py: using CellId 18018 01:09:24.363410 tst mo_mt_call_osmux.py: using BVCI 18019 01:09:24.475981 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:24.487274 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:24.498383 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:24.509664 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:24.521156 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:24.532309 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:09:24.650542 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:09:24.768568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:25.242925 run create_hlr_db(pid=5321): Launched 01:09:25.359643 bus /sierra_2: Setting Powered False 01:09:26.421257 run create_hlr_db(pid=5321): Terminated: ok {rc=0} 01:09:26.866521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5323): Launched 01:09:27.194363 run osmo-hlr_10.42.42.2(pid=5324): Launched 01:09:27.318563 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:27.879776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5326): Launched 01:09:28.206535 run osmo-stp_10.42.42.5(pid=5327): Launched 01:09:28.331470 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:28.920774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5329): Launched 01:09:29.247127 run osmo-msc_10.42.42.6(pid=5330): Launched 01:09:29.430746 run osmo-stp_10.42.42.5(pid=5327): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5327)] 01:09:29.567263 run osmo-stp_10.42.42.5(pid=5327): stdout: | (launched: 2022-12-09_01:09:28.146727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:29.704430 run osmo-stp_10.42.42.5(pid=5327): stderr: | 20221209010928338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010928338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010928338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010928339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010928341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010928341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010928341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:29.840885 run osmo-stp_10.42.42.5(pid=5327): stdout: | (launched: 2022-12-09_01:09:28.146727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:29.970304 run osmo-stp_10.42.42.5(pid=5327): stderr: | 20221209010928338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010928338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010928338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010928339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010928341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010928341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010928341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:30.126071 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5327): Process ended prematurely: osmo-stp_10.42.42.5(pid=5327) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5327)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:09:30.135942 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:09:30.164095 run osmo-hlr_10.42.42.2(pid=5324): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5324)] 01:09:30.214619 run osmo-hlr_10.42.42.2(pid=5324): stdout: | (launched: 2022-12-09_01:09:27.134201) 01:09:30.266680 run osmo-hlr_10.42.42.2(pid=5324): stderr: | 20221209010927335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010927335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010927335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010927335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010927335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010927335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010927347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010927355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010927356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010927356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:30.339293 run osmo-msc_10.42.42.6(pid=5330): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5330)] 01:09:30.389380 run osmo-msc_10.42.42.6(pid=5330): stdout: | (launched: 2022-12-09_01:09:29.187968) 01:09:30.441246 run osmo-msc_10.42.42.6(pid=5330): stderr: | 20221209010929510 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010929511 DLGLOBAL DEBUG validating counter group 0x7f46241b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010929511 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010929511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010929511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010929511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010929513 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010929513 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010929514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010929514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:30.493566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5323): Terminating (SIGTERM) 01:09:30.535411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5326): Terminating (SIGTERM) 01:09:30.577959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5329): Terminating (SIGTERM) 01:09:30.620162 --- ParallelTerminationStrategy: PID 5323 died... 01:09:30.640142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5323): Terminated: ok {rc=0} 01:09:30.686668 --- ParallelTerminationStrategy: PID 5326 died... 01:09:30.706235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5326): Terminated: ok {rc=0} 01:09:30.752320 --- ParallelTerminationStrategy: PID 5329 died... 01:09:30.771885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5329): Terminated: ok {rc=0} 01:09:30.867678 bus /sierra_3: Setting Powered False 01:09:31.971666 bus /sierra_3: Setting Powered False 01:09:33.087496 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:09:34.338263 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:09:34.347279 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:09:34.381815 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:09:34.409136 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:09:34.463124 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:09:34.497811 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:09:34.525693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:09:35.077825 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:09:35.129736 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:35.141491 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:09:35.213330 tst mo_mt_call.py: using LAC 18019 01:09:35.342289 tst mo_mt_call.py: using RAC 169 01:09:35.470811 tst mo_mt_call.py: using CellId 18019 01:09:35.599791 tst mo_mt_call.py: using BVCI 18020 01:09:35.719577 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:35.731378 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:35.742880 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:35.754494 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:35.766161 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:35.777797 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:35.893565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:36.013454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:36.519270 run create_hlr_db(pid=5335): Launched 01:09:36.651802 bus /sierra_2: Setting Powered False 01:09:37.715801 run create_hlr_db(pid=5335): Terminated: ok {rc=0} 01:09:38.153178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5337): Launched 01:09:38.459839 run osmo-hlr_10.42.42.2(pid=5338): Launched 01:09:38.577222 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:39.117652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5340): Launched 01:09:39.424069 run osmo-stp_10.42.42.5(pid=5341): Launched 01:09:39.541230 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:40.094906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5343): Launched 01:09:40.402105 run osmo-msc_10.42.42.6(pid=5344): Launched 01:09:40.573563 run osmo-stp_10.42.42.5(pid=5341): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5341)] 01:09:40.703693 run osmo-stp_10.42.42.5(pid=5341): stdout: | (launched: 2022-12-09_01:09:39.368289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:40.833456 run osmo-stp_10.42.42.5(pid=5341): stderr: | 20221209010939537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010939537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010939537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010939538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010939540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010939540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010939540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:40.960874 run osmo-stp_10.42.42.5(pid=5341): stdout: | (launched: 2022-12-09_01:09:39.368289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:41.082578 run osmo-stp_10.42.42.5(pid=5341): stderr: | 20221209010939537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010939537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010939537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010939538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010939540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010939540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010939540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:41.228232 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5341): Process ended prematurely: osmo-stp_10.42.42.5(pid=5341) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5341)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:09:41.237541 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:09:41.264602 run osmo-hlr_10.42.42.2(pid=5338): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5338)] 01:09:41.313486 run osmo-hlr_10.42.42.2(pid=5338): stdout: | (launched: 2022-12-09_01:09:38.403670) 01:09:41.363637 run osmo-hlr_10.42.42.2(pid=5338): stderr: | 20221209010938579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010938579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010938579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010938579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010938579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010938579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010938591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010938599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010938599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010938599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:41.433246 run osmo-msc_10.42.42.6(pid=5344): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5344)] 01:09:41.482018 run osmo-msc_10.42.42.6(pid=5344): stdout: | (launched: 2022-12-09_01:09:40.346407) 01:09:41.532243 run osmo-msc_10.42.42.6(pid=5344): stderr: | 20221209010940620 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010940620 DLGLOBAL DEBUG validating counter group 0x7f8ebf0f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010940620 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010940620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010940620 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010940621 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010940622 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010940623 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010940623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010940623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:41.583396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5337): Terminating (SIGTERM) 01:09:41.624049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5340): Terminating (SIGTERM) 01:09:41.664665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5343): Terminating (SIGTERM) 01:09:41.705395 --- ParallelTerminationStrategy: PID 5337 died... 01:09:41.724726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5337): Terminated: ok {rc=0} 01:09:41.770072 --- ParallelTerminationStrategy: PID 5340 died... 01:09:41.788783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5340): Terminated: ok {rc=0} 01:09:41.833582 --- ParallelTerminationStrategy: PID 5343 died... 01:09:41.852387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5343): Terminated: ok {rc=0} 01:09:41.937583 bus /sierra_3: Setting Powered False 01:09:43.036811 bus /sierra_3: Setting Powered False 01:09:44.153507 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:09:45.298498 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:45.310543 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:09:45.380674 tst mo_mt_call_osmux.py: using LAC 18020 01:09:45.500562 tst mo_mt_call_osmux.py: using RAC 170 01:09:45.620425 tst mo_mt_call_osmux.py: using CellId 18020 01:09:45.743676 tst mo_mt_call_osmux.py: using BVCI 18021 01:09:45.880616 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:45.900834 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:45.914282 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:45.927465 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:45.940693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:45.952703 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:46.081579 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:46.221635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:46.781668 run create_hlr_db(pid=5346): Launched 01:09:46.945235 bus /sierra_2: Setting Powered False 01:09:48.009796 run create_hlr_db(pid=5346): Terminated: ok {rc=0} 01:09:48.447103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5348): Launched 01:09:48.753601 run osmo-hlr_10.42.42.2(pid=5349): Launched 01:09:48.870930 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:49.397278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5351): Launched 01:09:49.701978 run osmo-stp_10.42.42.5(pid=5352): Launched 01:09:49.818962 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:50.372669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5354): Launched 01:09:50.680121 run osmo-msc_10.42.42.6(pid=5355): Launched 01:09:50.852406 run osmo-stp_10.42.42.5(pid=5352): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5352)] 01:09:50.982748 run osmo-stp_10.42.42.5(pid=5352): stdout: | (launched: 2022-12-09_01:09:49.646383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:51.112799 run osmo-stp_10.42.42.5(pid=5352): stderr: | 20221209010949816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010949816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010949816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010949816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010949819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010949819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010949819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:51.240815 run osmo-stp_10.42.42.5(pid=5352): stdout: | (launched: 2022-12-09_01:09:49.646383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:51.362557 run osmo-stp_10.42.42.5(pid=5352): stderr: | 20221209010949816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209010949816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209010949816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209010949816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209010949819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209010949819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209010949819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:51.508184 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5352): Process ended prematurely: osmo-stp_10.42.42.5(pid=5352) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5352)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:09:51.517314 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:09:51.544532 run osmo-hlr_10.42.42.2(pid=5349): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5349)] 01:09:51.593145 run osmo-hlr_10.42.42.2(pid=5349): stdout: | (launched: 2022-12-09_01:09:48.697962) 01:09:51.643408 run osmo-hlr_10.42.42.2(pid=5349): stderr: | 20221209010948876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010948876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010948876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010948876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010948876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010948876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209010948888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209010948897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209010948897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209010948897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:51.713132 run osmo-msc_10.42.42.6(pid=5355): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5355)] 01:09:51.761680 run osmo-msc_10.42.42.6(pid=5355): stdout: | (launched: 2022-12-09_01:09:50.624055) 01:09:51.812019 run osmo-msc_10.42.42.6(pid=5355): stderr: | 20221209010950898 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209010950898 DLGLOBAL DEBUG validating counter group 0x7f5d5088fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209010950898 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209010950898 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209010950898 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209010950898 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209010950900 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209010950901 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209010950901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209010950901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:51.862784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5348): Terminating (SIGTERM) 01:09:51.903127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5351): Terminating (SIGTERM) 01:09:51.943364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5354): Terminating (SIGTERM) 01:09:51.983890 --- ParallelTerminationStrategy: PID 5348 died... 01:09:52.003119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5348): Terminated: ok {rc=0} 01:09:52.047899 --- ParallelTerminationStrategy: PID 5351 died... 01:09:52.066847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5351): Terminated: ok {rc=0} 01:09:52.111593 --- ParallelTerminationStrategy: PID 5354 died... 01:09:52.130531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5354): Terminated: ok {rc=0} 01:09:52.215891 bus /sierra_3: Setting Powered False 01:09:53.315544 bus /sierra_3: Setting Powered False 01:09:54.433315 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:09:55.688390 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:09:55.695690 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:09:55.730506 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:09:55.757919 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:09:55.811004 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:09:55.845389 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:09:55.872445 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:09:56.430482 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:09:56.482510 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:56.494358 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:09:56.566145 tst mo_mt_call.py: using LAC 18021 01:09:56.694755 tst mo_mt_call.py: using RAC 171 01:09:56.823872 tst mo_mt_call.py: using CellId 18021 01:09:56.952286 tst mo_mt_call.py: using BVCI 18022 01:09:57.072834 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:57.084419 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:57.095850 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:57.107269 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:57.118848 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:57.130263 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:09:57.250851 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:09:57.369849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:57.874262 run create_hlr_db(pid=5360): Launched 01:09:58.006960 bus /sierra_2: Setting Powered False 01:09:59.071112 run create_hlr_db(pid=5360): Terminated: ok {rc=0} 01:09:59.524589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5362): Launched 01:09:59.850503 run osmo-hlr_10.42.42.2(pid=5363): Launched 01:09:59.974147 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:00.534993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5365): Launched 01:10:00.865793 run osmo-stp_10.42.42.5(pid=5366): Launched 01:10:01.090652 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:01.913361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5371): Launched 01:10:02.258442 run osmo-msc_10.42.42.6(pid=5372): Launched 01:10:02.524683 run osmo-stp_10.42.42.5(pid=5366): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5366)] 01:10:02.661059 run osmo-stp_10.42.42.5(pid=5366): stdout: | (launched: 2022-12-09_01:10:00.801164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:02.799697 run osmo-stp_10.42.42.5(pid=5366): stderr: | 20221209011001159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011001159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011001160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011001160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011001168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011001168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011001170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:02.936770 run osmo-stp_10.42.42.5(pid=5366): stdout: | (launched: 2022-12-09_01:10:00.801164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:03.067692 run osmo-stp_10.42.42.5(pid=5366): stderr: | 20221209011001159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011001159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011001160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011001160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011001168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011001168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011001170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:03.223705 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5366): Process ended prematurely: osmo-stp_10.42.42.5(pid=5366) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5366)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:10:03.233604 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 01:10:03.262070 run osmo-hlr_10.42.42.2(pid=5363): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5363)] 01:10:03.313858 run osmo-hlr_10.42.42.2(pid=5363): stdout: | (launched: 2022-12-09_01:09:59.791102) 01:10:03.366569 run osmo-hlr_10.42.42.2(pid=5363): stderr: | 20221209010959991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209010959991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209010959991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209010959991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209010959991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209010959991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011000003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011000012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011000012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011000012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:03.439931 run osmo-msc_10.42.42.6(pid=5372): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5372)] 01:10:03.490861 run osmo-msc_10.42.42.6(pid=5372): stdout: | (launched: 2022-12-09_01:10:02.196382) 01:10:03.543529 run osmo-msc_10.42.42.6(pid=5372): stderr: | 20221209011002555 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011002555 DLGLOBAL DEBUG validating counter group 0x7f8b0a406c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011002555 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011002555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011002555 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011002555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011002557 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011002557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011002558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011002558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:03.596346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5362): Terminating (SIGTERM) 01:10:03.639054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5365): Terminating (SIGTERM) 01:10:03.681734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5371): Terminating (SIGTERM) 01:10:03.724760 --- ParallelTerminationStrategy: PID 5362 died... 01:10:03.745010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5362): Terminated: ok {rc=0} 01:10:03.792750 --- ParallelTerminationStrategy: PID 5365 died... 01:10:03.812674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5365): Terminated: ok {rc=0} 01:10:03.860152 --- ParallelTerminationStrategy: PID 5371 died... 01:10:03.880019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5371): Terminated: ok {rc=0} 01:10:03.970295 bus /sierra_3: Setting Powered False 01:10:05.071385 bus /sierra_3: Setting Powered False 01:10:06.190061 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:10:07.337104 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:10:07.349169 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:10:07.419721 tst mo_mt_call_osmux.py: using LAC 18022 01:10:07.540153 tst mo_mt_call_osmux.py: using RAC 172 01:10:07.662644 tst mo_mt_call_osmux.py: using CellId 18022 01:10:07.784196 tst mo_mt_call_osmux.py: using BVCI 18023 01:10:07.896926 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:10:07.908226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:10:07.919193 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:10:07.930745 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:10:07.942306 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:10:07.953916 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:10:08.069294 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:10:08.189647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:08.696090 run create_hlr_db(pid=5374): Launched 01:10:08.829629 bus /sierra_2: Setting Powered False 01:10:09.894136 run create_hlr_db(pid=5374): Terminated: ok {rc=0} 01:10:10.330791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5376): Launched 01:10:10.636716 run osmo-hlr_10.42.42.2(pid=5377): Launched 01:10:10.754101 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:11.297304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5379): Launched 01:10:11.603666 run osmo-stp_10.42.42.5(pid=5380): Launched 01:10:11.720698 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:12.275155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5382): Launched 01:10:12.582493 run osmo-msc_10.42.42.6(pid=5383): Launched 01:10:12.754381 run osmo-stp_10.42.42.5(pid=5380): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5380)] 01:10:12.884833 run osmo-stp_10.42.42.5(pid=5380): stdout: | (launched: 2022-12-09_01:10:11.547758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:13.014208 run osmo-stp_10.42.42.5(pid=5380): stderr: | 20221209011011717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011011717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011011718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011011719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011011719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011011719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011011719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:13.141789 run osmo-stp_10.42.42.5(pid=5380): stdout: | (launched: 2022-12-09_01:10:11.547758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:13.263347 run osmo-stp_10.42.42.5(pid=5380): stderr: | 20221209011011717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011011717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011011718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011011719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011011719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011011719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011011719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:13.408609 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5380): Process ended prematurely: osmo-stp_10.42.42.5(pid=5380) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5380)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:10:13.417990 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:10:13.444821 run osmo-hlr_10.42.42.2(pid=5377): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5377)] 01:10:13.493495 run osmo-hlr_10.42.42.2(pid=5377): stdout: | (launched: 2022-12-09_01:10:10.581205) 01:10:13.544251 run osmo-hlr_10.42.42.2(pid=5377): stderr: | 20221209011010758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011010758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011010758 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011010758 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011010758 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011010758 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011010771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011010782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011010782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011010782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:13.614090 run osmo-msc_10.42.42.6(pid=5383): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5383)] 01:10:13.662431 run osmo-msc_10.42.42.6(pid=5383): stdout: | (launched: 2022-12-09_01:10:12.526588) 01:10:13.712514 run osmo-msc_10.42.42.6(pid=5383): stderr: | 20221209011012797 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011012797 DLGLOBAL DEBUG validating counter group 0x7fcaf85e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011012797 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011012797 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011012797 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011012799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011012800 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011012801 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011012801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011012801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:13.763033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5376): Terminating (SIGTERM) 01:10:13.803465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5379): Terminating (SIGTERM) 01:10:13.843840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5382): Terminating (SIGTERM) 01:10:13.884322 --- ParallelTerminationStrategy: PID 5376 died... 01:10:13.903520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5376): Terminated: ok {rc=0} 01:10:13.948525 --- ParallelTerminationStrategy: PID 5379 died... 01:10:13.967162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5379): Terminated: ok {rc=0} 01:10:14.012061 --- ParallelTerminationStrategy: PID 5382 died... 01:10:14.030905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5382): Terminated: ok {rc=0} 01:10:14.117853 bus /sierra_3: Setting Powered False 01:10:15.221089 bus /sierra_3: Setting Powered False 01:10:16.352338 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:10:17.624708 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:10:17.632060 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:10:17.667626 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:10:17.695333 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:10:17.750984 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:10:17.785601 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:10:17.812101 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:10:18.363828 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:10:18.416747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:18.428634 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:10:18.501074 tst mo_mt_call.py: using LAC 18023 01:10:18.631251 tst mo_mt_call.py: using RAC 173 01:10:18.761061 tst mo_mt_call.py: using CellId 18023 01:10:18.889392 tst mo_mt_call.py: using BVCI 18024 01:10:19.007348 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:19.019060 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:19.030975 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:19.043215 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:19.055092 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:19.066910 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:10:19.183380 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:10:19.302539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:19.807792 run create_hlr_db(pid=5388): Launched 01:10:19.940452 bus /sierra_2: Setting Powered False 01:10:21.005283 run create_hlr_db(pid=5388): Terminated: ok {rc=0} 01:10:21.444112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5390): Launched 01:10:21.750691 run osmo-hlr_10.42.42.2(pid=5391): Launched 01:10:21.869211 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:22.408717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5393): Launched 01:10:22.714265 run osmo-stp_10.42.42.5(pid=5394): Launched 01:10:22.830421 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:23.382198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5396): Launched 01:10:23.688716 run osmo-msc_10.42.42.6(pid=5397): Launched 01:10:23.860081 run osmo-stp_10.42.42.5(pid=5394): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5394)] 01:10:23.989312 run osmo-stp_10.42.42.5(pid=5394): stdout: | (launched: 2022-12-09_01:10:22.658114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:24.118847 run osmo-stp_10.42.42.5(pid=5394): stderr: | 20221209011022829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011022829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011022829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011022829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011022832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011022832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011022832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:24.246168 run osmo-stp_10.42.42.5(pid=5394): stdout: | (launched: 2022-12-09_01:10:22.658114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:24.367556 run osmo-stp_10.42.42.5(pid=5394): stderr: | 20221209011022829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011022829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011022829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011022829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011022832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011022832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011022832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:24.512731 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5394): Process ended prematurely: osmo-stp_10.42.42.5(pid=5394) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5394)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:10:24.521719 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:10:24.548602 run osmo-hlr_10.42.42.2(pid=5391): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5391)] 01:10:24.597557 run osmo-hlr_10.42.42.2(pid=5391): stdout: | (launched: 2022-12-09_01:10:21.695069) 01:10:24.647611 run osmo-hlr_10.42.42.2(pid=5391): stderr: | 20221209011021869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011021869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011021869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011021869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011021869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011021869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011021888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011021898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011021899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011021899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:24.717334 run osmo-msc_10.42.42.6(pid=5397): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5397)] 01:10:24.765504 run osmo-msc_10.42.42.6(pid=5397): stdout: | (launched: 2022-12-09_01:10:23.633157) 01:10:24.815238 run osmo-msc_10.42.42.6(pid=5397): stderr: | 20221209011023904 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011023904 DLGLOBAL DEBUG validating counter group 0x7f016c24cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011023904 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011023904 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011023904 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011023904 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011023906 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011023907 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011023907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011023907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:24.865819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5390): Terminating (SIGTERM) 01:10:24.905553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5393): Terminating (SIGTERM) 01:10:24.945916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5396): Terminating (SIGTERM) 01:10:24.986343 --- ParallelTerminationStrategy: PID 5390 died... 01:10:25.005517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5390): Terminated: ok {rc=0} 01:10:25.050119 --- ParallelTerminationStrategy: PID 5393 died... 01:10:25.068603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5393): Terminated: ok {rc=0} 01:10:25.114240 --- ParallelTerminationStrategy: PID 5396 died... 01:10:25.132818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5396): Terminated: ok {rc=0} 01:10:25.220439 bus /sierra_3: Setting Powered False 01:10:26.319909 bus /sierra_3: Setting Powered False 01:10:27.436147 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:10:28.589540 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:28.602182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:10:28.675906 tst mo_mt_call_osmux.py: using LAC 18024 01:10:28.805971 tst mo_mt_call_osmux.py: using RAC 174 01:10:28.926836 tst mo_mt_call_osmux.py: using CellId 18024 01:10:29.048543 tst mo_mt_call_osmux.py: using BVCI 18025 01:10:29.159447 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:29.170757 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:29.181797 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:29.193059 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:29.204566 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:29.215903 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:10:29.335129 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:10:29.458546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:29.964652 run create_hlr_db(pid=5401): Launched 01:10:30.099247 bus /sierra_2: Setting Powered False 01:10:31.179337 run create_hlr_db(pid=5401): Terminated: ok {rc=0} 01:10:31.640068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5403): Launched 01:10:31.967674 run osmo-hlr_10.42.42.2(pid=5404): Launched 01:10:32.107521 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:32.710030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5406): Launched 01:10:33.038880 run osmo-stp_10.42.42.5(pid=5407): Launched 01:10:33.164271 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:33.758599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5409): Launched 01:10:34.088791 run osmo-msc_10.42.42.6(pid=5410): Launched 01:10:34.271180 run osmo-stp_10.42.42.5(pid=5407): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5407)] 01:10:34.409110 run osmo-stp_10.42.42.5(pid=5407): stdout: | (launched: 2022-12-09_01:10:32.979472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:34.547394 run osmo-stp_10.42.42.5(pid=5407): stderr: | 20221209011033174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011033174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011033174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011033175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011033175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011033175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011033175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:34.685265 run osmo-stp_10.42.42.5(pid=5407): stdout: | (launched: 2022-12-09_01:10:32.979472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:34.816271 run osmo-stp_10.42.42.5(pid=5407): stderr: | 20221209011033174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011033174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011033174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011033175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011033175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011033175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011033175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:34.972921 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5407): Process ended prematurely: osmo-stp_10.42.42.5(pid=5407) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5407)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:10:34.983010 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 01:10:35.011662 run osmo-hlr_10.42.42.2(pid=5404): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5404)] 01:10:35.062765 run osmo-hlr_10.42.42.2(pid=5404): stdout: | (launched: 2022-12-09_01:10:31.910940) 01:10:35.115738 run osmo-hlr_10.42.42.2(pid=5404): stderr: | 20221209011032247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011032247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011032247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011032247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011032247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011032247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011032260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011032270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011032270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011032270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:35.188903 run osmo-msc_10.42.42.6(pid=5410): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5410)] 01:10:35.239598 run osmo-msc_10.42.42.6(pid=5410): stdout: | (launched: 2022-12-09_01:10:34.028928) 01:10:35.291561 run osmo-msc_10.42.42.6(pid=5410): stderr: | 20221209011034356 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011034357 DLGLOBAL DEBUG validating counter group 0x7f200c2e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011034357 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011034357 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011034357 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011034357 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011034359 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011034359 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011034359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011034359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:35.344060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5403): Terminating (SIGTERM) 01:10:35.386120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5406): Terminating (SIGTERM) 01:10:35.428211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5409): Terminating (SIGTERM) 01:10:35.470385 --- ParallelTerminationStrategy: PID 5403 died... 01:10:35.490695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5403): Terminated: ok {rc=0} 01:10:35.537674 --- ParallelTerminationStrategy: PID 5406 died... 01:10:35.557462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5406): Terminated: ok {rc=0} 01:10:35.603990 --- ParallelTerminationStrategy: PID 5409 died... 01:10:35.623884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5409): Terminated: ok {rc=0} 01:10:35.712585 bus /sierra_3: Setting Powered False 01:10:36.812710 bus /sierra_3: Setting Powered False 01:10:37.931133 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:10:39.196601 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:10:39.203837 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:10:39.238465 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:10:39.265706 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:10:39.319987 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:10:39.355413 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:10:39.382509 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:10:39.933941 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:10:39.986004 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:39.997914 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:10:40.070598 tst mo_mt_call.py: using LAC 18025 01:10:40.197979 tst mo_mt_call.py: using RAC 175 01:10:40.327546 tst mo_mt_call.py: using CellId 18025 01:10:40.454374 tst mo_mt_call.py: using BVCI 18026 01:10:40.574055 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:40.585936 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:40.597671 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:40.609319 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:40.620905 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:40.632535 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:40.748765 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:40.870573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:41.342948 run create_hlr_db(pid=5415): Launched 01:10:41.460820 bus /sierra_2: Setting Powered False 01:10:42.521641 run create_hlr_db(pid=5415): Terminated: ok {rc=0} 01:10:42.947998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5417): Launched 01:10:43.254307 run osmo-hlr_10.42.42.2(pid=5418): Launched 01:10:43.370787 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:43.905126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5420): Launched 01:10:44.210190 run osmo-stp_10.42.42.5(pid=5421): Launched 01:10:44.326790 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:44.880655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5423): Launched 01:10:45.186459 run osmo-msc_10.42.42.6(pid=5424): Launched 01:10:45.358359 run osmo-stp_10.42.42.5(pid=5421): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5421)] 01:10:45.488282 run osmo-stp_10.42.42.5(pid=5421): stdout: | (launched: 2022-12-09_01:10:44.154597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:45.618531 run osmo-stp_10.42.42.5(pid=5421): stderr: | 20221209011044323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011044323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011044323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011044324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011044326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011044326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011044326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:45.746334 run osmo-stp_10.42.42.5(pid=5421): stdout: | (launched: 2022-12-09_01:10:44.154597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:45.881914 run osmo-stp_10.42.42.5(pid=5421): stderr: | 20221209011044323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011044323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011044323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011044324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011044326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011044326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011044326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:46.045230 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5421): Process ended prematurely: osmo-stp_10.42.42.5(pid=5421) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5421)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:10:46.055697 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:10:46.086171 run osmo-hlr_10.42.42.2(pid=5418): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5418)] 01:10:46.139284 run osmo-hlr_10.42.42.2(pid=5418): stdout: | (launched: 2022-12-09_01:10:43.198455) 01:10:46.194128 run osmo-hlr_10.42.42.2(pid=5418): stderr: | 20221209011043373 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011043373 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011043373 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011043373 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011043373 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011043373 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011043386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011043395 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011043395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011043395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:46.271306 run osmo-msc_10.42.42.6(pid=5424): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5424)] 01:10:46.324088 run osmo-msc_10.42.42.6(pid=5424): stdout: | (launched: 2022-12-09_01:10:45.130733) 01:10:46.378139 run osmo-msc_10.42.42.6(pid=5424): stderr: | 20221209011045407 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011045407 DLGLOBAL DEBUG validating counter group 0x7ff13a113c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011045407 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011045407 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011045408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011045408 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011045410 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011045411 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011045411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011045411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:46.433920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5417): Terminating (SIGTERM) 01:10:46.478303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5420): Terminating (SIGTERM) 01:10:46.524068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5423): Terminating (SIGTERM) 01:10:46.570244 --- ParallelTerminationStrategy: PID 5417 died... 01:10:46.591591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5417): Terminated: ok {rc=0} 01:10:46.642329 --- ParallelTerminationStrategy: PID 5420 died... 01:10:46.663533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5420): Terminated: ok {rc=0} 01:10:46.711005 --- ParallelTerminationStrategy: PID 5423 died... 01:10:46.731633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5423): Terminated: ok {rc=0} 01:10:46.829461 bus /sierra_3: Setting Powered False 01:10:47.937817 bus /sierra_3: Setting Powered False 01:10:49.050848 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:10:50.202020 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:50.214844 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:10:50.288202 tst mo_mt_call_osmux.py: using LAC 18026 01:10:50.416728 tst mo_mt_call_osmux.py: using RAC 176 01:10:50.542097 tst mo_mt_call_osmux.py: using CellId 18026 01:10:50.662638 tst mo_mt_call_osmux.py: using BVCI 18027 01:10:50.776686 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:50.788010 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:50.799522 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:50.811668 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:50.823669 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:50.835518 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:50.956852 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:51.076649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:51.582699 run create_hlr_db(pid=5426): Launched 01:10:51.715370 bus /sierra_2: Setting Powered False 01:10:52.779604 run create_hlr_db(pid=5426): Terminated: ok {rc=0} 01:10:53.234009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5428): Launched 01:10:53.561245 run osmo-hlr_10.42.42.2(pid=5429): Launched 01:10:53.685840 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:54.247439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5431): Launched 01:10:54.573509 run osmo-stp_10.42.42.5(pid=5432): Launched 01:10:54.698457 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:55.291792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5434): Launched 01:10:55.618558 run osmo-msc_10.42.42.6(pid=5435): Launched 01:10:55.801546 run osmo-stp_10.42.42.5(pid=5432): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5432)] 01:10:55.939544 run osmo-stp_10.42.42.5(pid=5432): stdout: | (launched: 2022-12-09_01:10:54.514003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:56.078852 run osmo-stp_10.42.42.5(pid=5432): stderr: | 20221209011054707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011054707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011054707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011054708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011054708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011054708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011054708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:56.216035 run osmo-stp_10.42.42.5(pid=5432): stdout: | (launched: 2022-12-09_01:10:54.514003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:56.346283 run osmo-stp_10.42.42.5(pid=5432): stderr: | 20221209011054707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011054707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011054707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011054708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011054708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011054708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011054708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:56.502089 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5432): Process ended prematurely: osmo-stp_10.42.42.5(pid=5432) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5432)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:10:56.511896 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:10:56.539926 run osmo-hlr_10.42.42.2(pid=5429): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5429)] 01:10:56.590348 run osmo-hlr_10.42.42.2(pid=5429): stdout: | (launched: 2022-12-09_01:10:53.501504) 01:10:56.642708 run osmo-hlr_10.42.42.2(pid=5429): stderr: | 20221209011053701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011053701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011053701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011053701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011053701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011053701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011053714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011053722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011053722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011053722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:56.715202 run osmo-msc_10.42.42.6(pid=5435): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5435)] 01:10:56.765443 run osmo-msc_10.42.42.6(pid=5435): stdout: | (launched: 2022-12-09_01:10:55.559219) 01:10:56.817445 run osmo-msc_10.42.42.6(pid=5435): stderr: | 20221209011055883 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011055883 DLGLOBAL DEBUG validating counter group 0x7f7bbd308c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011055883 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011055883 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011055884 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011055884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011055886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011055886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011055886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011055886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:56.870221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5428): Terminating (SIGTERM) 01:10:56.912146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5431): Terminating (SIGTERM) 01:10:56.954201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5434): Terminating (SIGTERM) 01:10:56.996314 --- ParallelTerminationStrategy: PID 5428 died... 01:10:57.016544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5428): Terminated: ok {rc=0} 01:10:57.063580 --- ParallelTerminationStrategy: PID 5431 died... 01:10:57.083394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5431): Terminated: ok {rc=0} 01:10:57.129885 --- ParallelTerminationStrategy: PID 5434 died... 01:10:57.149663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5434): Terminated: ok {rc=0} 01:10:57.238886 bus /sierra_3: Setting Powered False 01:10:58.338322 bus /sierra_3: Setting Powered False 01:10:59.455484 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:11:00.706248 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:11:00.713775 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:11:00.749450 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:11:00.777226 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:11:00.846412 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:11:00.882686 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:11:00.920843 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:11:01.475049 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:11:01.530398 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:01.542571 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:11:01.620532 tst mo_mt_call.py: using LAC 18027 01:11:01.787116 tst mo_mt_call.py: using RAC 177 01:11:01.947401 tst mo_mt_call.py: using CellId 18027 01:11:02.070531 tst mo_mt_call.py: using BVCI 18028 01:11:02.215478 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:02.227548 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:02.239491 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:02.252180 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:02.265927 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:02.278844 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:11:02.397422 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:11:02.517293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:03.024016 run create_hlr_db(pid=5440): Launched 01:11:03.158125 bus /sierra_2: Setting Powered False 01:11:04.222737 run create_hlr_db(pid=5440): Terminated: ok {rc=0} 01:11:04.659207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5442): Launched 01:11:04.965614 run osmo-hlr_10.42.42.2(pid=5443): Launched 01:11:05.083648 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:05.625198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5445): Launched 01:11:05.931338 run osmo-stp_10.42.42.5(pid=5446): Launched 01:11:06.047833 run osmo-msc_10.42.42.6: Starting osmo-msc 01:11:06.600759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5448): Launched 01:11:06.907512 run osmo-msc_10.42.42.6(pid=5449): Launched 01:11:07.080020 run osmo-stp_10.42.42.5(pid=5446): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5446)] 01:11:07.210074 run osmo-stp_10.42.42.5(pid=5446): stdout: | (launched: 2022-12-09_01:11:05.875301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:07.339491 run osmo-stp_10.42.42.5(pid=5446): stderr: | 20221209011106046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011106047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011106047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011106048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011106050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011106050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011106050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:07.467174 run osmo-stp_10.42.42.5(pid=5446): stdout: | (launched: 2022-12-09_01:11:05.875301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:07.589123 run osmo-stp_10.42.42.5(pid=5446): stderr: | 20221209011106046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011106047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011106047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011106048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011106050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011106050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011106050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:07.735161 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5446): Process ended prematurely: osmo-stp_10.42.42.5(pid=5446) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5446)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:11:07.744311 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:11:07.771421 run osmo-hlr_10.42.42.2(pid=5443): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5443)] 01:11:07.820061 run osmo-hlr_10.42.42.2(pid=5443): stdout: | (launched: 2022-12-09_01:11:04.909848) 01:11:07.870080 run osmo-hlr_10.42.42.2(pid=5443): stderr: | 20221209011105087 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011105087 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011105087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011105087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011105087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011105087 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011105099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011105107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011105107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011105107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:07.939822 run osmo-msc_10.42.42.6(pid=5449): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5449)] 01:11:07.987937 run osmo-msc_10.42.42.6(pid=5449): stdout: | (launched: 2022-12-09_01:11:06.851612) 01:11:08.037979 run osmo-msc_10.42.42.6(pid=5449): stderr: | 20221209011107123 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011107123 DLGLOBAL DEBUG validating counter group 0x7f3efc330c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011107124 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011107124 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011107124 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011107124 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011107126 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011107126 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011107126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011107126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:11:08.088459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5442): Terminating (SIGTERM) 01:11:08.129013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5445): Terminating (SIGTERM) 01:11:08.169438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5448): Terminating (SIGTERM) 01:11:08.210392 --- ParallelTerminationStrategy: PID 5442 died... 01:11:08.229643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5442): Terminated: ok {rc=0} 01:11:08.274720 --- ParallelTerminationStrategy: PID 5445 died... 01:11:08.293532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5445): Terminated: ok {rc=0} 01:11:08.338650 --- ParallelTerminationStrategy: PID 5448 died... 01:11:08.357893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5448): Terminated: ok {rc=0} 01:11:08.444699 bus /sierra_3: Setting Powered False 01:11:09.544118 bus /sierra_3: Setting Powered False 01:11:10.661034 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:11:11.807679 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:11.819714 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:11:11.891606 tst mo_mt_call_osmux.py: using LAC 18028 01:11:12.013815 tst mo_mt_call_osmux.py: using RAC 178 01:11:12.137385 tst mo_mt_call_osmux.py: using CellId 18028 01:11:12.258820 tst mo_mt_call_osmux.py: using BVCI 18029 01:11:12.371999 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:12.383183 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:12.394122 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:12.405726 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:12.416925 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:11:12.428179 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:11:12.547950 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:11:12.667782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:13.140686 run create_hlr_db(pid=5451): Launched 01:11:13.257675 bus /sierra_2: Setting Powered False 01:11:14.318220 run create_hlr_db(pid=5451): Terminated: ok {rc=0} 01:11:14.764719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5453): Launched 01:11:15.091507 run osmo-hlr_10.42.42.2(pid=5454): Launched 01:11:15.216380 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:15.777694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5456): Launched 01:11:16.158936 run osmo-stp_10.42.42.5(pid=5457): Launched 01:11:16.397233 run osmo-msc_10.42.42.6: Starting osmo-msc 01:11:17.162996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5459): Launched 01:11:17.500110 run osmo-msc_10.42.42.6(pid=5460): Launched 01:11:17.683030 run osmo-stp_10.42.42.5(pid=5457): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5457)] 01:11:17.819736 run osmo-stp_10.42.42.5(pid=5457): stdout: | (launched: 2022-12-09_01:11:16.099468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:17.957723 run osmo-stp_10.42.42.5(pid=5457): stderr: | 20221209011116355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011116355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011116356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011116356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011116363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011116363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011116363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:18.095644 run osmo-stp_10.42.42.5(pid=5457): stdout: | (launched: 2022-12-09_01:11:16.099468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:18.226439 run osmo-stp_10.42.42.5(pid=5457): stderr: | 20221209011116355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011116355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011116356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011116356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011116363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011116363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011116363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:18.382289 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5457): Process ended prematurely: osmo-stp_10.42.42.5(pid=5457) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5457)] [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:11:18.392051 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 01:11:18.420653 run osmo-hlr_10.42.42.2(pid=5454): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5454)] 01:11:18.471780 run osmo-hlr_10.42.42.2(pid=5454): stdout: | (launched: 2022-12-09_01:11:15.032143) 01:11:18.524447 run osmo-hlr_10.42.42.2(pid=5454): stderr: | 20221209011115231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011115231 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011115231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011115231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011115231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011115231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011115243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011115252 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011115252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011115252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:18.597503 run osmo-msc_10.42.42.6(pid=5460): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5460)] 01:11:18.648222 run osmo-msc_10.42.42.6(pid=5460): stdout: | (launched: 2022-12-09_01:11:17.440776) 01:11:18.700394 run osmo-msc_10.42.42.6(pid=5460): stderr: | 20221209011117765 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011117765 DLGLOBAL DEBUG validating counter group 0x7fe49044fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011117765 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011117765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011117765 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011117765 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011117767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011117767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011117768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011117768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:11:18.752836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5453): Terminating (SIGTERM) 01:11:18.794988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5456): Terminating (SIGTERM) 01:11:18.837239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5459): Terminating (SIGTERM) 01:11:18.879590 --- ParallelTerminationStrategy: PID 5453 died... 01:11:18.899730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5453): Terminated: ok {rc=0} 01:11:18.947084 --- ParallelTerminationStrategy: PID 5456 died... 01:11:18.966885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5456): Terminated: ok {rc=0} 01:11:19.013800 --- ParallelTerminationStrategy: PID 5459 died... 01:11:19.033914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5459): Terminated: ok {rc=0} 01:11:19.123418 bus /sierra_3: Setting Powered False 01:11:20.223440 bus /sierra_3: Setting Powered False 01:11:21.341282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 01:11:22.587242 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:11:22.591718 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:11:22.625812 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:11:22.652723 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 01:11:22.736861 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:11:22.770326 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:11:22.796434 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 01:11:23.380552 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2352 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 01:11:23.385634 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:23.396558 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:23.446753 tst emergency_mo_mt_call.py: using LAC 18029 01:11:23.565621 tst emergency_mo_mt_call.py: using RAC 179 01:11:23.682423 tst emergency_mo_mt_call.py: using CellId 18029 01:11:23.801223 tst emergency_mo_mt_call.py: using BVCI 18030 01:11:23.918027 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:23.929577 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:23.940807 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:23.952140 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:23.963689 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:23.975131 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:24.091649 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:24.205602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:24.668185 run create_hlr_db(pid=5465): Launched 01:11:24.784933 bus /sierra_2: Setting Powered False 01:11:25.845255 run create_hlr_db(pid=5465): Terminated: ok {rc=0} 01:11:26.286413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5467): Launched 01:11:26.609890 run osmo-hlr_10.42.42.2(pid=5468): Launched 01:11:26.733095 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:27.286798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5470): Launched 01:11:27.609208 run osmo-stp_10.42.42.5(pid=5471): Launched 01:11:27.743266 tst emergency_mo_mt_call.py: using MSISDN 6948 01:11:27.907059 run osmo-msc_10.42.42.6: Starting osmo-msc 01:11:28.485185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5473): Launched 01:11:28.807462 run osmo-msc_10.42.42.6(pid=5474): Launched 01:11:28.988699 run osmo-stp_10.42.42.5(pid=5471): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5471)] 01:11:29.125317 run osmo-stp_10.42.42.5(pid=5471): stdout: | (launched: 2022-12-09_01:11:27.550574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:29.261380 run osmo-stp_10.42.42.5(pid=5471): stderr: | 20221209011127741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011127741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011127742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011127742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011127743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011127743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011127743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:29.396182 run osmo-stp_10.42.42.5(pid=5471): stdout: | (launched: 2022-12-09_01:11:27.550574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:29.523929 run osmo-stp_10.42.42.5(pid=5471): stderr: | 20221209011127741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011127741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011127742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011127742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011127743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011127743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011127743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:29.676363 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5471): Process ended prematurely: osmo-stp_10.42.42.5(pid=5471) [trial-2352↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5471)] [trial-2352↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 01:11:29.685793 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 01:11:29.713635 run osmo-hlr_10.42.42.2(pid=5468): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5468)] 01:11:29.764746 run osmo-hlr_10.42.42.2(pid=5468): stdout: | (launched: 2022-12-09_01:11:26.550881) 01:11:29.817453 run osmo-hlr_10.42.42.2(pid=5468): stderr: | 20221209011126748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011126748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011126748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011126748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011126748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011126748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011126760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011126768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011126769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011126769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:29.891079 run osmo-msc_10.42.42.6(pid=5474): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5474)] 01:11:29.942363 run osmo-msc_10.42.42.6(pid=5474): stdout: | (launched: 2022-12-09_01:11:28.748344) 01:11:29.994985 run osmo-msc_10.42.42.6(pid=5474): stderr: | 20221209011129069 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011129069 DLGLOBAL DEBUG validating counter group 0x7fa8b93a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011129070 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011129070 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011129070 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011129070 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011129072 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011129072 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011129072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011129072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:11:30.048058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5467): Terminating (SIGTERM) 01:11:30.090963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5470): Terminating (SIGTERM) 01:11:30.133552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5473): Terminating (SIGTERM) 01:11:30.176009 --- ParallelTerminationStrategy: PID 5467 died... 01:11:30.196008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5467): Terminated: ok {rc=0} 01:11:30.243103 --- ParallelTerminationStrategy: PID 5470 died... 01:11:30.262928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5470): Terminated: ok {rc=0} 01:11:30.309599 --- ParallelTerminationStrategy: PID 5473 died... 01:11:30.329509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5473): Terminated: ok {rc=0} 01:11:30.418678 bus /sierra_3: Setting Powered False 01:11:31.517032 bus /sierra_3: Setting Powered False 01:11:32.634724 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 01:11:33.722804 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:33.735364 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:33.789574 tst emergency_preemptive_call.py: using LAC 18030 01:11:33.917089 tst emergency_preemptive_call.py: using RAC 180 01:11:34.044820 tst emergency_preemptive_call.py: using CellId 18030 01:11:34.170730 tst emergency_preemptive_call.py: using BVCI 18031 01:11:34.287077 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:34.298596 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:34.309712 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:34.320800 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:34.331901 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:34.343138 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:34.459277 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:34.577769 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:34.698588 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:34.812609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:35.282539 run create_hlr_db(pid=5476): Launched 01:11:35.398792 bus /sierra_2: Setting Powered False 01:11:36.459174 run create_hlr_db(pid=5476): Terminated: ok {rc=0} 01:11:36.882174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5478): Launched 01:11:37.187139 run osmo-hlr_10.42.42.2(pid=5479): Launched 01:11:37.302854 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:37.834441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5481): Launched 01:11:38.136035 run osmo-stp_10.42.42.5(pid=5482): Launched 01:11:38.260335 tst emergency_preemptive_call.py: using MSISDN 6949 01:11:38.413749 run osmo-msc_10.42.42.6: Starting osmo-msc 01:11:38.954588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5484): Launched 01:11:39.258294 run osmo-msc_10.42.42.6(pid=5485): Launched 01:11:39.428756 run osmo-stp_10.42.42.5(pid=5482): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5482)] 01:11:39.556280 run osmo-stp_10.42.42.5(pid=5482): stdout: | (launched: 2022-12-09_01:11:38.080557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:39.684631 run osmo-stp_10.42.42.5(pid=5482): stderr: | 20221209011138250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011138251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011138251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011138251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011138252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011138252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011138252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:39.810496 run osmo-stp_10.42.42.5(pid=5482): stdout: | (launched: 2022-12-09_01:11:38.080557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:39.930632 run osmo-stp_10.42.42.5(pid=5482): stderr: | 20221209011138250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011138251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011138251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011138251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011138252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011138252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011138252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:40.074236 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5482): Process ended prematurely: osmo-stp_10.42.42.5(pid=5482) [trial-2352↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5482)] [trial-2352↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 01:11:40.082877 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 01:11:40.110638 run osmo-hlr_10.42.42.2(pid=5479): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5479)] 01:11:40.159951 run osmo-hlr_10.42.42.2(pid=5479): stdout: | (launched: 2022-12-09_01:11:37.131491) 01:11:40.211059 run osmo-hlr_10.42.42.2(pid=5479): stderr: | 20221209011137308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011137308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011137308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011137308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011137308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011137308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011137321 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011137329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011137329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011137329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:40.281922 run osmo-msc_10.42.42.6(pid=5485): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5485)] 01:11:40.330886 run osmo-msc_10.42.42.6(pid=5485): stdout: | (launched: 2022-12-09_01:11:39.202794) 01:11:40.381753 run osmo-msc_10.42.42.6(pid=5485): stderr: | 20221209011139476 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011139476 DLGLOBAL DEBUG validating counter group 0x7ffbc7f3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011139476 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011139476 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011139476 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011139477 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011139478 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011139479 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011139479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011139479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:11:40.433241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5478): Terminating (SIGTERM) 01:11:40.474615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5481): Terminating (SIGTERM) 01:11:40.515972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5484): Terminating (SIGTERM) 01:11:40.557291 --- ParallelTerminationStrategy: PID 5478 died... 01:11:40.576692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5478): Terminated: ok {rc=0} 01:11:40.622657 --- ParallelTerminationStrategy: PID 5481 died... 01:11:40.641775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5481): Terminated: ok {rc=0} 01:11:40.687279 --- ParallelTerminationStrategy: PID 5484 died... 01:11:40.706413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5484): Terminated: ok {rc=0} 01:11:40.795144 bus /sierra_9: Setting Powered False 01:11:41.897060 bus /sierra_9: Setting Powered False 01:11:43.014313 bus /sierra_8: Setting Powered False 01:11:44.114411 bus /sierra_8: Setting Powered False 01:11:45.231865 bus /sierra_3: Setting Powered False 01:11:46.328850 bus /sierra_3: Setting Powered False 01:11:47.444204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 01:11:48.735338 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:11:48.740152 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:11:48.775111 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 01:11:48.815127 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 01:11:48.905940 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:11:48.941659 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 01:11:48.980763 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 01:11:49.566564 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 01:11:49.618306 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:49.629156 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:49.679102 tst cs_paging_gprs_active.py: using LAC 18031 01:11:49.801446 tst cs_paging_gprs_active.py: using RAC 181 01:11:49.924064 tst cs_paging_gprs_active.py: using CellId 18031 01:11:50.046334 tst cs_paging_gprs_active.py: using BVCI 18032 01:11:50.160548 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.171497 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.182256 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.193033 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.203888 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.215089 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.226115 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.236846 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.247911 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:50.367969 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:50.488911 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:11:50.710808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:51.039817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5490): Launched 01:11:51.327500 run iperf3-srv_10.42.42.10(pid=5491): Launched 01:11:51.451190 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:11:51.672794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:52.003010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5492): Launched 01:11:52.292001 run iperf3-srv_10.42.42.10(pid=5493): Launched 01:11:52.415595 tst cs_paging_gprs_active.py:38: start network... 01:11:52.637118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:53.147558 run create_hlr_db(pid=5494): Launched 01:11:53.281121 bus /sierra_2: Setting Powered False 01:11:54.346318 run create_hlr_db(pid=5494): Terminated: ok {rc=0} 01:11:54.785719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5496): Launched 01:11:55.094501 run osmo-hlr_10.42.42.2(pid=5497): Launched 01:11:55.212332 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:55.758494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5499): Launched 01:11:56.065554 run osmo-stp_10.42.42.5(pid=5500): Launched 01:11:56.183132 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:11:56.713324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5502): Launched 01:11:56.831154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:11:57.090729 run patchelf(pid=5503): Launched 01:11:57.262669 run osmo-stp_10.42.42.5(pid=5500): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5500)] 01:11:57.393869 run osmo-stp_10.42.42.5(pid=5500): stdout: | (launched: 2022-12-09_01:11:56.009597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:57.527042 run osmo-stp_10.42.42.5(pid=5500): stderr: | 20221209011156179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011156179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011156180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011156180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011156181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011156181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011156181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:57.659808 run osmo-stp_10.42.42.5(pid=5500): stdout: | (launched: 2022-12-09_01:11:56.009597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:57.785762 run osmo-stp_10.42.42.5(pid=5500): stderr: | 20221209011156179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011156179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011156180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011156180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011156181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011156181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011156181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:57.935156 run patchelf(pid=5503): Terminating (SIGINT) 01:11:58.108543 run patchelf(pid=5503): Terminated: ok {rc=0} 01:11:58.233671 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5500): Process ended prematurely: osmo-stp_10.42.42.5(pid=5500) [trial-2352↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5500)] [trial-2352↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 01:11:58.243220 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:11:58.271123 run osmo-hlr_10.42.42.2(pid=5497): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5497)] 01:11:58.319831 run osmo-hlr_10.42.42.2(pid=5497): stdout: | (launched: 2022-12-09_01:11:55.037959) 01:11:58.369886 run osmo-hlr_10.42.42.2(pid=5497): stderr: | 20221209011155216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011155216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011155216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011155216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011155216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011155216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011155228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011155238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011155238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011155238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:58.420449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5490): Terminating (SIGTERM) 01:11:58.460873 run iperf3-srv_10.42.42.10(pid=5491): Terminating (SIGTERM) 01:11:58.502604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5492): Terminating (SIGTERM) 01:11:58.543491 run iperf3-srv_10.42.42.10(pid=5493): Terminating (SIGTERM) 01:11:58.583730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5496): Terminating (SIGTERM) 01:11:58.624028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5499): Terminating (SIGTERM) 01:11:58.664210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5502): Terminating (SIGTERM) 01:11:58.704736 --- ParallelTerminationStrategy: PID 5490 died... 01:11:58.723934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5490): Terminated: ok {rc=0} 01:11:58.768785 --- ParallelTerminationStrategy: PID 5491 died... 01:11:58.787552 run iperf3-srv_10.42.42.10(pid=5491): Terminated {rc=256} 01:11:58.832097 --- ParallelTerminationStrategy: PID 5492 died... 01:11:58.850845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5492): Terminated: ok {rc=0} 01:11:58.895205 --- ParallelTerminationStrategy: PID 5493 died... 01:11:58.913838 run iperf3-srv_10.42.42.10(pid=5493): Terminated {rc=256} 01:11:58.958189 --- ParallelTerminationStrategy: PID 5496 died... 01:11:58.976986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5496): Terminated: ok {rc=0} 01:11:59.021522 --- ParallelTerminationStrategy: PID 5499 died... 01:11:59.040225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5499): Terminated: ok {rc=0} 01:11:59.084625 --- ParallelTerminationStrategy: PID 5502 died... 01:11:59.103433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5502): Terminated: ok {rc=0} 01:11:59.189815 bus /gobi_0: Setting Powered False 01:12:00.289472 bus /gobi_0: Setting Powered False 01:12:01.406248 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 01:12:02.551637 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:02.563109 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:12:02.615555 tst iperf3.py: using LAC 18032 01:12:02.744505 tst iperf3.py: using RAC 182 01:12:02.872085 tst iperf3.py: using CellId 18032 01:12:03.010758 tst iperf3.py: using BVCI 18033 01:12:03.125103 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:03.136063 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:03.148003 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:03.158896 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:03.169555 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:03.180385 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:03.191430 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:03.202161 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:03.213504 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:03.331962 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:12:03.554632 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:03.883799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5504): Launched 01:12:04.173808 run iperf3-srv_10.42.42.10(pid=5505): Launched 01:12:04.297909 tst iperf3.py:8: start network... 01:12:04.520850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:05.032660 run create_hlr_db(pid=5506): Launched 01:12:05.167466 bus /gobi_6: Setting Powered False 01:12:06.232201 run create_hlr_db(pid=5506): Terminated: ok {rc=0} 01:12:06.688704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5508): Launched 01:12:07.017644 run osmo-hlr_10.42.42.2(pid=5509): Launched 01:12:07.143765 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:07.713444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5511): Launched 01:12:08.042956 run osmo-stp_10.42.42.5(pid=5512): Launched 01:12:08.170772 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:08.738886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5514): Launched 01:12:08.866437 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:09.145327 run patchelf(pid=5515): Launched 01:12:09.328937 run osmo-stp_10.42.42.5(pid=5512): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5512)] 01:12:09.469362 run osmo-stp_10.42.42.5(pid=5512): stdout: | (launched: 2022-12-09_01:12:07.983277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:09.611145 run osmo-stp_10.42.42.5(pid=5512): stderr: | 20221209011208176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011208177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011208177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011208177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011208178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011208178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011208178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:09.752515 run osmo-stp_10.42.42.5(pid=5512): stdout: | (launched: 2022-12-09_01:12:07.983277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:09.887626 run osmo-stp_10.42.42.5(pid=5512): stderr: | 20221209011208176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011208177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011208177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011208177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011208178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011208178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011208178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:10.047929 run patchelf(pid=5515): Terminating (SIGINT) 01:12:10.233661 run patchelf(pid=5515): Terminated: ok {rc=0} 01:12:10.367115 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5512): Process ended prematurely: osmo-stp_10.42.42.5(pid=5512) [trial-2352↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5512)] [trial-2352↪gprs:trx-sysmocell5000↪iperf3.py:8] 01:12:10.377669 tst iperf3.py:8: Test FAILED (7.9 sec) 01:12:10.406506 run osmo-hlr_10.42.42.2(pid=5509): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5509)] 01:12:10.457123 run osmo-hlr_10.42.42.2(pid=5509): stdout: | (launched: 2022-12-09_01:12:06.957485) 01:12:10.509380 run osmo-hlr_10.42.42.2(pid=5509): stderr: | 20221209011207157 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011207157 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011207157 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011207157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011207157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011207157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011207170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011207178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011207178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011207178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:10.562446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5504): Terminating (SIGTERM) 01:12:10.604694 run iperf3-srv_10.42.42.10(pid=5505): Terminating (SIGTERM) 01:12:10.646968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5508): Terminating (SIGTERM) 01:12:10.689519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5511): Terminating (SIGTERM) 01:12:10.731888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5514): Terminating (SIGTERM) 01:12:10.774567 --- ParallelTerminationStrategy: PID 5504 died... 01:12:10.794775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5504): Terminated: ok {rc=0} 01:12:10.841680 --- ParallelTerminationStrategy: PID 5505 died... 01:12:10.861541 run iperf3-srv_10.42.42.10(pid=5505): Terminated {rc=256} 01:12:10.908214 --- ParallelTerminationStrategy: PID 5508 died... 01:12:10.928188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5508): Terminated: ok {rc=0} 01:12:10.974927 --- ParallelTerminationStrategy: PID 5511 died... 01:12:10.994688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5511): Terminated: ok {rc=0} 01:12:11.041472 --- ParallelTerminationStrategy: PID 5514 died... 01:12:11.061455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5514): Terminated: ok {rc=0} 01:12:11.150764 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 01:12:12.302984 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:12.314988 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:12:12.370693 tst iperf3m4.py: using LAC 18033 01:12:12.497566 tst iperf3m4.py: using RAC 183 01:12:12.626337 tst iperf3m4.py: using CellId 18033 01:12:12.750139 tst iperf3m4.py: using BVCI 18034 01:12:12.870862 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:12.882360 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:12.893604 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:12.904849 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:12.916085 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:12.927721 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:12.939105 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:12.950228 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:12.961673 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:13.077968 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:13.202032 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:13.323583 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:13.444862 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:12:13.667357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:13.996837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5516): Launched 01:12:14.283834 run iperf3-srv_10.42.42.10(pid=5517): Launched 01:12:14.407773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:12:14.629589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:14.959185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5518): Launched 01:12:15.246721 run iperf3-srv_10.42.42.10(pid=5519): Launched 01:12:15.371767 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:12:15.594619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:15.946542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5520): Launched 01:12:16.250927 run iperf3-srv_10.42.42.10(pid=5521): Launched 01:12:16.405917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:12:16.620024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:16.938381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5522): Launched 01:12:17.238011 run iperf3-srv_10.42.42.10(pid=5523): Launched 01:12:17.363307 tst iperf3m4.py:8: start network... 01:12:17.586540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:18.096288 run create_hlr_db(pid=5524): Launched 01:12:18.230852 bus /gobi_6: Setting Powered False 01:12:19.295808 run create_hlr_db(pid=5524): Terminated: ok {rc=0} 01:12:19.752500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5526): Launched 01:12:20.081680 run osmo-hlr_10.42.42.2(pid=5527): Launched 01:12:20.207779 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:20.776346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5529): Launched 01:12:21.106142 run osmo-stp_10.42.42.5(pid=5530): Launched 01:12:21.232427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:21.800703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5532): Launched 01:12:21.926656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:22.204092 run patchelf(pid=5533): Launched 01:12:22.387480 run osmo-stp_10.42.42.5(pid=5530): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5530)] 01:12:22.527221 run osmo-stp_10.42.42.5(pid=5530): stdout: | (launched: 2022-12-09_01:12:21.045781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:22.668201 run osmo-stp_10.42.42.5(pid=5530): stderr: | 20221209011221238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011221238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011221238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011221239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011221239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011221239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011221239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:22.809076 run osmo-stp_10.42.42.5(pid=5530): stdout: | (launched: 2022-12-09_01:12:21.045781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:22.943713 run osmo-stp_10.42.42.5(pid=5530): stderr: | 20221209011221238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011221238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011221238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011221239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011221239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011221239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011221239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:23.104079 run patchelf(pid=5533): Terminating (SIGINT) 01:12:23.288750 run patchelf(pid=5533): Terminated: ok {rc=0} 01:12:23.421826 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5530): Process ended prematurely: osmo-stp_10.42.42.5(pid=5530) [trial-2352↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5530)] [trial-2352↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 01:12:23.432106 tst iperf3m4.py:8: Test FAILED (11.2 sec) 01:12:23.461415 run osmo-hlr_10.42.42.2(pid=5527): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5527)] 01:12:23.512157 run osmo-hlr_10.42.42.2(pid=5527): stdout: | (launched: 2022-12-09_01:12:20.021454) 01:12:23.565128 run osmo-hlr_10.42.42.2(pid=5527): stderr: | 20221209011220220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011220220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011220220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011220220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011220220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011220220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011220233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011220241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011220242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011220242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:23.617892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5516): Terminating (SIGTERM) 01:12:23.660443 run iperf3-srv_10.42.42.10(pid=5517): Terminating (SIGTERM) 01:12:23.703001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5518): Terminating (SIGTERM) 01:12:23.745600 run iperf3-srv_10.42.42.10(pid=5519): Terminating (SIGTERM) 01:12:23.788010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5520): Terminating (SIGTERM) 01:12:23.830668 run iperf3-srv_10.42.42.10(pid=5521): Terminating (SIGTERM) 01:12:23.872938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5522): Terminating (SIGTERM) 01:12:23.915512 run iperf3-srv_10.42.42.10(pid=5523): Terminating (SIGTERM) 01:12:23.957775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5526): Terminating (SIGTERM) 01:12:24.000307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5529): Terminating (SIGTERM) 01:12:24.042825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5532): Terminating (SIGTERM) 01:12:24.085697 --- ParallelTerminationStrategy: PID 5516 died... 01:12:24.106049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5516): Terminated: ok {rc=0} 01:12:24.153297 --- ParallelTerminationStrategy: PID 5517 died... 01:12:24.173128 run iperf3-srv_10.42.42.10(pid=5517): Terminated {rc=256} 01:12:24.220314 --- ParallelTerminationStrategy: PID 5518 died... 01:12:24.240445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5518): Terminated: ok {rc=0} 01:12:24.287281 --- ParallelTerminationStrategy: PID 5519 died... 01:12:24.307188 run iperf3-srv_10.42.42.10(pid=5519): Terminated {rc=256} 01:12:24.354030 --- ParallelTerminationStrategy: PID 5520 died... 01:12:24.373984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5520): Terminated: ok {rc=0} 01:12:24.420749 --- ParallelTerminationStrategy: PID 5521 died... 01:12:24.440627 run iperf3-srv_10.42.42.10(pid=5521): Terminated {rc=256} 01:12:24.487427 --- ParallelTerminationStrategy: PID 5522 died... 01:12:24.507196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5522): Terminated: ok {rc=0} 01:12:24.554014 --- ParallelTerminationStrategy: PID 5523 died... 01:12:24.573963 run iperf3-srv_10.42.42.10(pid=5523): Terminated {rc=256} 01:12:24.620881 --- ParallelTerminationStrategy: PID 5526 died... 01:12:24.641158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5526): Terminated: ok {rc=0} 01:12:24.688056 --- ParallelTerminationStrategy: PID 5529 died... 01:12:24.708177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5529): Terminated: ok {rc=0} 01:12:24.755011 --- ParallelTerminationStrategy: PID 5532 died... 01:12:24.774973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5532): Terminated: ok {rc=0} 01:12:24.864184 bus /gobi_4: Setting Powered False 01:12:25.966406 bus /gobi_4: Setting Powered False 01:12:27.085264 bus /gobi_1: Setting Powered False 01:12:28.185720 bus /gobi_1: Setting Powered False 01:12:29.303530 bus /gobi_0: Setting Powered False 01:12:30.404281 bus /gobi_0: Setting Powered False 01:12:31.524572 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 01:12:32.627418 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:32.638956 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:12:32.690272 tst ping.py: using LAC 18034 01:12:32.809422 tst ping.py: using RAC 184 01:12:32.926756 tst ping.py: using CellId 18034 01:12:33.046756 tst ping.py: using BVCI 18035 01:12:33.157936 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:33.168580 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:33.179179 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:33.190014 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:33.200673 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:33.211434 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:33.222376 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:33.233212 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:33.347821 tst ping.py:19: start network... 01:12:33.549530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:34.015198 run create_hlr_db(pid=5534): Launched 01:12:34.130185 bus /gobi_6: Setting Powered False 01:12:35.189947 run create_hlr_db(pid=5534): Terminated: ok {rc=0} 01:12:35.630929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5536): Launched 01:12:35.944285 run osmo-hlr_10.42.42.2(pid=5540): Launched 01:12:36.061449 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:36.599452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5542): Launched 01:12:36.902570 run osmo-stp_10.42.42.5(pid=5543): Launched 01:12:37.018228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:37.538282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5545): Launched 01:12:37.654362 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:37.908912 run patchelf(pid=5546): Launched 01:12:38.079779 run osmo-stp_10.42.42.5(pid=5543): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5543)] 01:12:38.208072 run osmo-stp_10.42.42.5(pid=5543): stdout: | (launched: 2022-12-09_01:12:36.846787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:38.337466 run osmo-stp_10.42.42.5(pid=5543): stderr: | 20221209011237017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011237017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011237017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011237018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011237020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011237020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011237020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:38.467056 run osmo-stp_10.42.42.5(pid=5543): stdout: | (launched: 2022-12-09_01:12:36.846787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:38.590489 run osmo-stp_10.42.42.5(pid=5543): stderr: | 20221209011237017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011237017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011237017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011237018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011237020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011237020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011237020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:38.736361 run patchelf(pid=5546): Terminating (SIGINT) 01:12:38.905573 run patchelf(pid=5546): Terminated: ok {rc=0} 01:12:39.027845 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5543): Process ended prematurely: osmo-stp_10.42.42.5(pid=5543) [trial-2352↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5543)] [trial-2352↪gprs:trx-sysmocell5000↪ping.py:22] 01:12:39.036886 tst ping.py:22: Test FAILED (6.4 sec) 01:12:39.064789 run osmo-hlr_10.42.42.2(pid=5540): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5540)] 01:12:39.113863 run osmo-hlr_10.42.42.2(pid=5540): stdout: | (launched: 2022-12-09_01:12:35.889600) 01:12:39.164577 run osmo-hlr_10.42.42.2(pid=5540): stderr: | 20221209011236065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011236065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011236065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011236065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011236066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011236066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011236077 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011236086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011236086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011236086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:39.215775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5536): Terminating (SIGTERM) 01:12:39.256515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5542): Terminating (SIGTERM) 01:12:39.297204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5545): Terminating (SIGTERM) 01:12:39.338220 --- ParallelTerminationStrategy: PID 5536 died... 01:12:39.357557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5536): Terminated: ok {rc=0} 01:12:39.402697 --- ParallelTerminationStrategy: PID 5542 died... 01:12:39.421979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5542): Terminated: ok {rc=0} 01:12:39.466754 --- ParallelTerminationStrategy: PID 5545 died... 01:12:39.485599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5545): Terminated: ok {rc=0} 01:12:39.572568 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 01:12:40.662947 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:40.674903 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:12:40.726833 tst ping_idle_ping.py: using LAC 18035 01:12:40.845913 tst ping_idle_ping.py: using RAC 185 01:12:40.966017 tst ping_idle_ping.py: using CellId 18035 01:12:41.083523 tst ping_idle_ping.py: using BVCI 18036 01:12:41.195300 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:41.206126 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:41.216669 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:41.227510 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:41.238203 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:41.248901 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:41.259906 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:41.270639 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:41.385126 tst ping_idle_ping.py:24: start network... 01:12:41.587645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:42.056631 run create_hlr_db(pid=5547): Launched 01:12:42.172199 bus /gobi_6: Setting Powered False 01:12:43.233290 run create_hlr_db(pid=5547): Terminated: ok {rc=0} 01:12:43.676714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5549): Launched 01:12:44.001307 run osmo-hlr_10.42.42.2(pid=5550): Launched 01:12:44.127351 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:44.684588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5552): Launched 01:12:45.007437 run osmo-stp_10.42.42.5(pid=5553): Launched 01:12:45.133906 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:45.693715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5555): Launched 01:12:45.819704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:46.120682 run patchelf(pid=5556): Launched 01:12:46.305596 run osmo-stp_10.42.42.5(pid=5553): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5553)] 01:12:46.447539 run osmo-stp_10.42.42.5(pid=5553): stdout: | (launched: 2022-12-09_01:12:44.948403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:46.589570 run osmo-stp_10.42.42.5(pid=5553): stderr: | 20221209011245141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011245141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011245141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011245142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011245144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011245144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011245144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:46.731266 run osmo-stp_10.42.42.5(pid=5553): stdout: | (launched: 2022-12-09_01:12:44.948403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:46.866718 run osmo-stp_10.42.42.5(pid=5553): stderr: | 20221209011245141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011245141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011245141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011245142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011245144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011245144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011245144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:47.027073 run patchelf(pid=5556): Terminating (SIGINT) 01:12:47.211155 run patchelf(pid=5556): Terminated: ok {rc=0} 01:12:47.341598 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5553): Process ended prematurely: osmo-stp_10.42.42.5(pid=5553) [trial-2352↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5553)] [trial-2352↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 01:12:47.351325 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:12:47.379728 run osmo-hlr_10.42.42.2(pid=5550): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5550)] 01:12:47.430076 run osmo-hlr_10.42.42.2(pid=5550): stdout: | (launched: 2022-12-09_01:12:43.942355) 01:12:47.482137 run osmo-hlr_10.42.42.2(pid=5550): stderr: | 20221209011244142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011244142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011244142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011244142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011244142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011244142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011244155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011244163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011244163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011244164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:47.534793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5549): Terminating (SIGTERM) 01:12:47.576922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5552): Terminating (SIGTERM) 01:12:47.619149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5555): Terminating (SIGTERM) 01:12:47.661559 --- ParallelTerminationStrategy: PID 5549 died... 01:12:47.681724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5549): Terminated: ok {rc=0} 01:12:47.728526 --- ParallelTerminationStrategy: PID 5552 died... 01:12:47.748471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5552): Terminated: ok {rc=0} 01:12:47.795087 --- ParallelTerminationStrategy: PID 5555 died... 01:12:47.814885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5555): Terminated: ok {rc=0} 01:12:47.903315 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 01:12:49.222382 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:12:49.228532 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:12:49.263299 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:12:49.302662 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:12:49.391440 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:12:49.425863 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:12:49.465267 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:12:50.061604 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:12:50.114461 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.125816 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:12:50.178525 tst cs_paging_gprs_active.py: using LAC 18036 01:12:50.308773 tst cs_paging_gprs_active.py: using RAC 186 01:12:50.438539 tst cs_paging_gprs_active.py: using CellId 18036 01:12:50.566676 tst cs_paging_gprs_active.py: using BVCI 18037 01:12:50.687289 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.698810 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.710045 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.721327 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.732408 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.743783 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.755137 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.766301 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.777710 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:50.893453 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:51.013782 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:12:51.220182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:51.529738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5561): Launched 01:12:51.799405 run iperf3-srv_10.42.42.10(pid=5562): Launched 01:12:51.915482 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:12:52.121389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:52.429620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5563): Launched 01:12:52.698775 run iperf3-srv_10.42.42.10(pid=5564): Launched 01:12:52.816490 tst cs_paging_gprs_active.py:38: start network... 01:12:53.022577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:53.498558 run create_hlr_db(pid=5565): Launched 01:12:53.617158 bus /gobi_6: Setting Powered False 01:12:54.678029 run create_hlr_db(pid=5565): Terminated: ok {rc=0} 01:12:55.128050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5567): Launched 01:12:55.457993 run osmo-hlr_10.42.42.2(pid=5568): Launched 01:12:55.586189 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:56.154658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5570): Launched 01:12:56.484649 run osmo-stp_10.42.42.5(pid=5571): Launched 01:12:56.611172 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:57.178647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5573): Launched 01:12:57.307126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:57.585184 run patchelf(pid=5574): Launched 01:12:57.768515 run osmo-stp_10.42.42.5(pid=5571): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5571)] 01:12:57.908069 run osmo-stp_10.42.42.5(pid=5571): stdout: | (launched: 2022-12-09_01:12:56.424182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:58.048921 run osmo-stp_10.42.42.5(pid=5571): stderr: | 20221209011256621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011256621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011256621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011256622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011256622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011256622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011256622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:58.191225 run osmo-stp_10.42.42.5(pid=5571): stdout: | (launched: 2022-12-09_01:12:56.424182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:58.325797 run osmo-stp_10.42.42.5(pid=5571): stderr: | 20221209011256621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011256621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011256621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011256622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011256622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011256622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011256622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:58.485046 run patchelf(pid=5574): Terminating (SIGINT) 01:12:58.669079 run patchelf(pid=5574): Terminated: ok {rc=0} 01:12:58.801778 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5571): Process ended prematurely: osmo-stp_10.42.42.5(pid=5571) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5571)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:12:58.811990 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:12:58.840823 run osmo-hlr_10.42.42.2(pid=5568): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5568)] 01:12:58.891345 run osmo-hlr_10.42.42.2(pid=5568): stdout: | (launched: 2022-12-09_01:12:55.398425) 01:12:58.943521 run osmo-hlr_10.42.42.2(pid=5568): stderr: | 20221209011255596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011255596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011255597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011255597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011255597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011255597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011255610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011255619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011255619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011255619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:58.996206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5561): Terminating (SIGTERM) 01:12:59.038359 run iperf3-srv_10.42.42.10(pid=5562): Terminating (SIGTERM) 01:12:59.080374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5563): Terminating (SIGTERM) 01:12:59.122958 run iperf3-srv_10.42.42.10(pid=5564): Terminating (SIGTERM) 01:12:59.166429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5567): Terminating (SIGTERM) 01:12:59.208821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5570): Terminating (SIGTERM) 01:12:59.250920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5573): Terminating (SIGTERM) 01:12:59.293256 --- ParallelTerminationStrategy: PID 5561 died... 01:12:59.313277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5561): Terminated: ok {rc=0} 01:12:59.359664 --- ParallelTerminationStrategy: PID 5562 died... 01:12:59.379166 run iperf3-srv_10.42.42.10(pid=5562): Terminated {rc=256} 01:12:59.425506 --- ParallelTerminationStrategy: PID 5563 died... 01:12:59.445125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5563): Terminated: ok {rc=0} 01:12:59.491805 --- ParallelTerminationStrategy: PID 5564 died... 01:12:59.511390 run iperf3-srv_10.42.42.10(pid=5564): Terminated {rc=256} 01:12:59.557571 --- ParallelTerminationStrategy: PID 5567 died... 01:12:59.577187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5567): Terminated: ok {rc=0} 01:12:59.623306 --- ParallelTerminationStrategy: PID 5570 died... 01:12:59.642933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5570): Terminated: ok {rc=0} 01:12:59.689159 --- ParallelTerminationStrategy: PID 5573 died... 01:12:59.708645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5573): Terminated: ok {rc=0} 01:12:59.797559 bus /gobi_0: Setting Powered False 01:13:00.903213 bus /gobi_0: Setting Powered False 01:13:02.036483 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:13:03.203896 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:03.215970 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:13:03.271711 tst iperf3.py: using LAC 18037 01:13:03.402564 tst iperf3.py: using RAC 187 01:13:03.525405 tst iperf3.py: using CellId 18037 01:13:03.652368 tst iperf3.py: using BVCI 18038 01:13:03.764588 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:03.775709 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:03.786694 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:03.797845 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:03.808557 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:03.819539 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:03.830682 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:03.841488 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:03.852583 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:03.971738 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:13:04.193730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:04.522430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5575): Launched 01:13:04.809747 run iperf3-srv_10.42.42.10(pid=5576): Launched 01:13:04.933599 tst iperf3.py:8: start network... 01:13:05.156463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:05.666391 run create_hlr_db(pid=5577): Launched 01:13:05.792463 bus /gobi_6: Setting Powered False 01:13:06.853357 run create_hlr_db(pid=5577): Terminated: ok {rc=0} 01:13:07.278760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5579): Launched 01:13:07.587817 run osmo-hlr_10.42.42.2(pid=5580): Launched 01:13:07.705724 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:08.250724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5582): Launched 01:13:08.556860 run osmo-stp_10.42.42.5(pid=5583): Launched 01:13:08.675216 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:09.204009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5585): Launched 01:13:09.322404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:09.581551 run patchelf(pid=5586): Launched 01:13:09.754959 run osmo-stp_10.42.42.5(pid=5583): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5583)] 01:13:09.885440 run osmo-stp_10.42.42.5(pid=5583): stdout: | (launched: 2022-12-09_01:13:08.500555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:10.017956 run osmo-stp_10.42.42.5(pid=5583): stderr: | 20221209011308672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011308673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011308673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011308673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011308674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011308674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011308674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:10.149997 run osmo-stp_10.42.42.5(pid=5583): stdout: | (launched: 2022-12-09_01:13:08.500555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:10.275874 run osmo-stp_10.42.42.5(pid=5583): stderr: | 20221209011308672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011308673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011308673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011308673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011308674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011308674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011308674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:10.424911 run patchelf(pid=5586): Terminating (SIGINT) 01:13:10.597894 run patchelf(pid=5586): Terminated: ok {rc=0} 01:13:10.722700 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5583): Process ended prematurely: osmo-stp_10.42.42.5(pid=5583) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5583)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 01:13:10.732225 tst iperf3.py:8: Test FAILED (7.6 sec) 01:13:10.759844 run osmo-hlr_10.42.42.2(pid=5580): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5580)] 01:13:10.808330 run osmo-hlr_10.42.42.2(pid=5580): stdout: | (launched: 2022-12-09_01:13:07.531901) 01:13:10.858487 run osmo-hlr_10.42.42.2(pid=5580): stderr: | 20221209011307709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011307709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011307709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011307709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011307709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011307709 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011307722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011307730 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011307731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011307731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:10.909184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5575): Terminating (SIGTERM) 01:13:10.949591 run iperf3-srv_10.42.42.10(pid=5576): Terminating (SIGTERM) 01:13:10.989953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5579): Terminating (SIGTERM) 01:13:11.030378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5582): Terminating (SIGTERM) 01:13:11.070784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5585): Terminating (SIGTERM) 01:13:11.111492 --- ParallelTerminationStrategy: PID 5575 died... 01:13:11.130820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5575): Terminated: ok {rc=0} 01:13:11.175984 --- ParallelTerminationStrategy: PID 5576 died... 01:13:11.194923 run iperf3-srv_10.42.42.10(pid=5576): Terminated {rc=256} 01:13:11.239615 --- ParallelTerminationStrategy: PID 5579 died... 01:13:11.258594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5579): Terminated: ok {rc=0} 01:13:11.303430 --- ParallelTerminationStrategy: PID 5582 died... 01:13:11.322142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5582): Terminated: ok {rc=0} 01:13:11.366846 --- ParallelTerminationStrategy: PID 5585 died... 01:13:11.385757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5585): Terminated: ok {rc=0} 01:13:11.472581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:13:12.621441 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:12.633353 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:13:12.686468 tst iperf3m4.py: using LAC 18038 01:13:12.807898 tst iperf3m4.py: using RAC 188 01:13:12.929878 tst iperf3m4.py: using CellId 18038 01:13:13.050534 tst iperf3m4.py: using BVCI 18039 01:13:13.164105 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:13.175207 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:13.185942 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:13.196808 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:13.207733 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:13.218902 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:13.230000 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:13.240801 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:13.252292 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:13.372783 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:13.492312 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:13.612035 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:13.733145 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:13:13.956274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:14.287306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5587): Launched 01:13:14.574260 run iperf3-srv_10.42.42.10(pid=5588): Launched 01:13:14.699834 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:13:14.923219 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:15.255238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5589): Launched 01:13:15.541837 run iperf3-srv_10.42.42.10(pid=5590): Launched 01:13:15.667319 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:13:15.931402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:16.287073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5591): Launched 01:13:16.579362 run iperf3-srv_10.42.42.10(pid=5592): Launched 01:13:16.741375 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:13:16.967818 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:17.303517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5593): Launched 01:13:17.590079 run iperf3-srv_10.42.42.10(pid=5594): Launched 01:13:17.715172 tst iperf3m4.py:8: start network... 01:13:17.937970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:18.449659 run create_hlr_db(pid=5595): Launched 01:13:18.585213 bus /gobi_6: Setting Powered False 01:13:19.649851 run create_hlr_db(pid=5595): Terminated: ok {rc=0} 01:13:20.089844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5597): Launched 01:13:20.399296 run osmo-hlr_10.42.42.2(pid=5598): Launched 01:13:20.517380 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:21.062328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5600): Launched 01:13:21.370680 run osmo-stp_10.42.42.5(pid=5601): Launched 01:13:21.487660 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:22.017715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5603): Launched 01:13:22.136583 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:22.396679 run patchelf(pid=5604): Launched 01:13:22.568508 run osmo-stp_10.42.42.5(pid=5601): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5601)] 01:13:22.699403 run osmo-stp_10.42.42.5(pid=5601): stdout: | (launched: 2022-12-09_01:13:21.314001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:22.831753 run osmo-stp_10.42.42.5(pid=5601): stderr: | 20221209011321483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011321483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011321483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011321484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011321484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011321484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011321484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:22.963999 run osmo-stp_10.42.42.5(pid=5601): stdout: | (launched: 2022-12-09_01:13:21.314001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:23.090012 run osmo-stp_10.42.42.5(pid=5601): stderr: | 20221209011321483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011321483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011321483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011321484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011321484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011321484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011321484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:23.239102 run patchelf(pid=5604): Terminating (SIGINT) 01:13:23.412062 run patchelf(pid=5604): Terminated: ok {rc=0} 01:13:23.537495 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5601): Process ended prematurely: osmo-stp_10.42.42.5(pid=5601) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5601)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 01:13:23.547195 tst iperf3m4.py:8: Test FAILED (11.0 sec) 01:13:23.575649 run osmo-hlr_10.42.42.2(pid=5598): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5598)] 01:13:23.624028 run osmo-hlr_10.42.42.2(pid=5598): stdout: | (launched: 2022-12-09_01:13:20.342878) 01:13:23.674278 run osmo-hlr_10.42.42.2(pid=5598): stderr: | 20221209011320520 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011320520 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011320520 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011320520 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011320520 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011320520 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011320533 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011320542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011320542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011320542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:23.725127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5587): Terminating (SIGTERM) 01:13:23.765658 run iperf3-srv_10.42.42.10(pid=5588): Terminating (SIGTERM) 01:13:23.806107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5589): Terminating (SIGTERM) 01:13:23.846601 run iperf3-srv_10.42.42.10(pid=5590): Terminating (SIGTERM) 01:13:23.886918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5591): Terminating (SIGTERM) 01:13:23.927345 run iperf3-srv_10.42.42.10(pid=5592): Terminating (SIGTERM) 01:13:23.967685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5593): Terminating (SIGTERM) 01:13:24.008209 run iperf3-srv_10.42.42.10(pid=5594): Terminating (SIGTERM) 01:13:24.049054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5597): Terminating (SIGTERM) 01:13:24.090369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5600): Terminating (SIGTERM) 01:13:24.130969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5603): Terminating (SIGTERM) 01:13:24.171788 --- ParallelTerminationStrategy: PID 5587 died... 01:13:24.191139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5587): Terminated: ok {rc=0} 01:13:24.236237 --- ParallelTerminationStrategy: PID 5588 died... 01:13:24.254905 run iperf3-srv_10.42.42.10(pid=5588): Terminated {rc=256} 01:13:24.299679 --- ParallelTerminationStrategy: PID 5589 died... 01:13:24.318509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5589): Terminated: ok {rc=0} 01:13:24.363500 --- ParallelTerminationStrategy: PID 5590 died... 01:13:24.382136 run iperf3-srv_10.42.42.10(pid=5590): Terminated {rc=256} 01:13:24.426859 --- ParallelTerminationStrategy: PID 5591 died... 01:13:24.445791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5591): Terminated: ok {rc=0} 01:13:24.490598 --- ParallelTerminationStrategy: PID 5592 died... 01:13:24.509505 run iperf3-srv_10.42.42.10(pid=5592): Terminated {rc=256} 01:13:24.554570 --- ParallelTerminationStrategy: PID 5593 died... 01:13:24.573445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5593): Terminated: ok {rc=0} 01:13:24.618780 --- ParallelTerminationStrategy: PID 5594 died... 01:13:24.637969 run iperf3-srv_10.42.42.10(pid=5594): Terminated {rc=256} 01:13:24.682768 --- ParallelTerminationStrategy: PID 5597 died... 01:13:24.701646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5597): Terminated: ok {rc=0} 01:13:24.746440 --- ParallelTerminationStrategy: PID 5600 died... 01:13:24.765303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5600): Terminated: ok {rc=0} 01:13:24.810150 --- ParallelTerminationStrategy: PID 5603 died... 01:13:24.829192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5603): Terminated: ok {rc=0} 01:13:24.916331 bus /gobi_4: Setting Powered False 01:13:26.017952 bus /gobi_4: Setting Powered False 01:13:27.134691 bus /gobi_1: Setting Powered False 01:13:28.234327 bus /gobi_1: Setting Powered False 01:13:29.351182 bus /gobi_0: Setting Powered False 01:13:30.450025 bus /gobi_0: Setting Powered False 01:13:31.564593 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 01:13:32.666152 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:32.677887 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:13:32.729296 tst ping.py: using LAC 18039 01:13:32.848067 tst ping.py: using RAC 189 01:13:32.966187 tst ping.py: using CellId 18039 01:13:33.084266 tst ping.py: using BVCI 18040 01:13:33.195849 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:33.206921 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:33.217763 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:33.228836 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:33.239791 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:33.250792 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:33.261927 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:33.272834 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:33.389706 tst ping.py:19: start network... 01:13:33.590738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:34.053049 run create_hlr_db(pid=5606): Launched 01:13:34.167527 bus /gobi_6: Setting Powered False 01:13:35.227374 run create_hlr_db(pid=5606): Terminated: ok {rc=0} 01:13:35.646999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5608): Launched 01:13:35.951473 run osmo-hlr_10.42.42.2(pid=5609): Launched 01:13:36.066684 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:36.586917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5611): Launched 01:13:36.888494 run osmo-stp_10.42.42.5(pid=5612): Launched 01:13:37.003939 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:37.525249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5614): Launched 01:13:37.641251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:37.896323 run patchelf(pid=5615): Launched 01:13:38.064306 run osmo-stp_10.42.42.5(pid=5612): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5612)] 01:13:38.193553 run osmo-stp_10.42.42.5(pid=5612): stdout: | (launched: 2022-12-09_01:13:36.833170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:38.323739 run osmo-stp_10.42.42.5(pid=5612): stderr: | 20221209011337001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011337001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011337002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011337002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011337005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011337006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011337006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:38.453908 run osmo-stp_10.42.42.5(pid=5612): stdout: | (launched: 2022-12-09_01:13:36.833170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:38.577749 run osmo-stp_10.42.42.5(pid=5612): stderr: | 20221209011337001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011337001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011337002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011337002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011337005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011337006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011337006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:38.723862 run patchelf(pid=5615): Terminating (SIGINT) 01:13:38.893885 run patchelf(pid=5615): Terminated: ok {rc=0} 01:13:39.016562 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5612): Process ended prematurely: osmo-stp_10.42.42.5(pid=5612) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5612)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 01:13:39.025744 tst ping.py:22: Test FAILED (6.4 sec) 01:13:39.053300 run osmo-hlr_10.42.42.2(pid=5609): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5609)] 01:13:39.102093 run osmo-hlr_10.42.42.2(pid=5609): stdout: | (launched: 2022-12-09_01:13:35.895577) 01:13:39.152501 run osmo-hlr_10.42.42.2(pid=5609): stderr: | 20221209011336072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011336072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011336072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011336072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011336072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011336072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011336104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011336115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011336116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011336116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:39.203219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5608): Terminating (SIGTERM) 01:13:39.243738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5611): Terminating (SIGTERM) 01:13:39.284432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5614): Terminating (SIGTERM) 01:13:39.325219 --- ParallelTerminationStrategy: PID 5608 died... 01:13:39.344484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5608): Terminated: ok {rc=0} 01:13:39.389804 --- ParallelTerminationStrategy: PID 5611 died... 01:13:39.408550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5611): Terminated: ok {rc=0} 01:13:39.454129 --- ParallelTerminationStrategy: PID 5614 died... 01:13:39.473034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5614): Terminated: ok {rc=0} 01:13:39.560077 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:13:40.650688 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:40.662934 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:13:40.716196 tst ping_idle_ping.py: using LAC 18040 01:13:40.848793 tst ping_idle_ping.py: using RAC 190 01:13:40.975568 tst ping_idle_ping.py: using CellId 18040 01:13:41.094337 tst ping_idle_ping.py: using BVCI 18041 01:13:41.205658 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:41.216746 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:41.227737 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:41.239044 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:41.250235 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:41.261460 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:41.272592 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:41.283540 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:41.402300 tst ping_idle_ping.py:24: start network... 01:13:41.622489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:42.127399 run create_hlr_db(pid=5616): Launched 01:13:42.260618 bus /gobi_6: Setting Powered False 01:13:43.325820 run create_hlr_db(pid=5616): Terminated: ok {rc=0} 01:13:43.778723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5618): Launched 01:13:44.104015 run osmo-hlr_10.42.42.2(pid=5619): Launched 01:13:44.228998 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:44.791276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5621): Launched 01:13:45.116429 run osmo-stp_10.42.42.5(pid=5622): Launched 01:13:45.241867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:45.804721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5624): Launched 01:13:45.946630 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:46.237812 run patchelf(pid=5625): Launched 01:13:46.419848 run osmo-stp_10.42.42.5(pid=5622): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5622)] 01:13:46.556591 run osmo-stp_10.42.42.5(pid=5622): stdout: | (launched: 2022-12-09_01:13:45.057314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:46.692701 run osmo-stp_10.42.42.5(pid=5622): stderr: | 20221209011345252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011345252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011345252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011345253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011345253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011345253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011345253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:46.828562 run osmo-stp_10.42.42.5(pid=5622): stdout: | (launched: 2022-12-09_01:13:45.057314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:46.958199 run osmo-stp_10.42.42.5(pid=5622): stderr: | 20221209011345252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011345252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011345252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011345253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011345253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011345253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011345253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:47.110885 run patchelf(pid=5625): Terminating (SIGINT) 01:13:47.286012 run patchelf(pid=5625): Terminated: ok {rc=0} 01:13:47.409817 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5622): Process ended prematurely: osmo-stp_10.42.42.5(pid=5622) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5622)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 01:13:47.419206 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 01:13:47.447811 run osmo-hlr_10.42.42.2(pid=5619): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5619)] 01:13:47.497111 run osmo-hlr_10.42.42.2(pid=5619): stdout: | (launched: 2022-12-09_01:13:44.044731) 01:13:47.547934 run osmo-hlr_10.42.42.2(pid=5619): stderr: | 20221209011344246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011344246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011344246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011344246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011344246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011344246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011344258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011344266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011344267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011344267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:47.599396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5618): Terminating (SIGTERM) 01:13:47.640546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5621): Terminating (SIGTERM) 01:13:47.681752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5624): Terminating (SIGTERM) 01:13:47.723148 --- ParallelTerminationStrategy: PID 5618 died... 01:13:47.742745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5618): Terminated: ok {rc=0} 01:13:47.788860 --- ParallelTerminationStrategy: PID 5621 died... 01:13:47.808615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5621): Terminated: ok {rc=0} 01:13:47.854765 --- ParallelTerminationStrategy: PID 5624 died... 01:13:47.874206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5624): Terminated: ok {rc=0} 01:13:47.964190 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:13:49.278240 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:13:49.284359 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:13:49.318795 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:13:49.357350 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:13:49.443384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:13:49.476863 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:13:49.515260 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:13:50.111657 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:13:50.162307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:50.173483 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:13:50.244915 tst cs_paging_gprs_active.py: using LAC 18041 01:13:50.375742 tst cs_paging_gprs_active.py: using RAC 191 01:13:50.506323 tst cs_paging_gprs_active.py: using CellId 18041 01:13:50.636472 tst cs_paging_gprs_active.py: using BVCI 18042 01:13:50.755782 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:50.767332 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:50.778801 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:50.790132 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:50.801381 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:50.812564 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:50.824047 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:50.835132 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:50.846504 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:50.966813 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:51.088329 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:13:51.310868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:51.640752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5629): Launched 01:13:51.928183 run iperf3-srv_10.42.42.10(pid=5630): Launched 01:13:52.051972 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:13:52.275241 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:52.605529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5631): Launched 01:13:52.893167 run iperf3-srv_10.42.42.10(pid=5632): Launched 01:13:53.016870 tst cs_paging_gprs_active.py:38: start network... 01:13:53.239421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:53.749760 run create_hlr_db(pid=5633): Launched 01:13:53.885564 bus /gobi_6: Setting Powered False 01:13:54.950354 run create_hlr_db(pid=5633): Terminated: ok {rc=0} 01:13:55.391198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5635): Launched 01:13:55.699194 run osmo-hlr_10.42.42.2(pid=5636): Launched 01:13:55.818332 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:56.347683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5638): Launched 01:13:56.655874 run osmo-stp_10.42.42.5(pid=5639): Launched 01:13:56.774880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:57.306976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5641): Launched 01:13:57.426134 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:57.686002 run patchelf(pid=5642): Launched 01:13:57.858206 run osmo-stp_10.42.42.5(pid=5639): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5639)] 01:13:57.988592 run osmo-stp_10.42.42.5(pid=5639): stdout: | (launched: 2022-12-09_01:13:56.599789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:58.121195 run osmo-stp_10.42.42.5(pid=5639): stderr: | 20221209011356769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011356769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011356770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011356770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011356770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011356771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011356771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:58.253724 run osmo-stp_10.42.42.5(pid=5639): stdout: | (launched: 2022-12-09_01:13:56.599789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:58.380234 run osmo-stp_10.42.42.5(pid=5639): stderr: | 20221209011356769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011356769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011356770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011356770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011356770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011356771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011356771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:58.529374 run patchelf(pid=5642): Terminating (SIGINT) 01:13:58.702150 run patchelf(pid=5642): Terminated: ok {rc=0} 01:13:58.827035 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5639): Process ended prematurely: osmo-stp_10.42.42.5(pid=5639) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5639)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:13:58.836710 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:13:58.864455 run osmo-hlr_10.42.42.2(pid=5636): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5636)] 01:13:58.913126 run osmo-hlr_10.42.42.2(pid=5636): stdout: | (launched: 2022-12-09_01:13:55.643256) 01:13:58.963128 run osmo-hlr_10.42.42.2(pid=5636): stderr: | 20221209011355820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011355820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011355820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011355820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011355820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011355820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011355863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011355873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011355873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011355873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:59.014196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5629): Terminating (SIGTERM) 01:13:59.054706 run iperf3-srv_10.42.42.10(pid=5630): Terminating (SIGTERM) 01:13:59.095064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5631): Terminating (SIGTERM) 01:13:59.135435 run iperf3-srv_10.42.42.10(pid=5632): Terminating (SIGTERM) 01:13:59.175654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5635): Terminating (SIGTERM) 01:13:59.216041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5638): Terminating (SIGTERM) 01:13:59.256202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5641): Terminating (SIGTERM) 01:13:59.296681 --- ParallelTerminationStrategy: PID 5629 died... 01:13:59.315855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5629): Terminated: ok {rc=0} 01:13:59.360717 --- ParallelTerminationStrategy: PID 5630 died... 01:13:59.379395 run iperf3-srv_10.42.42.10(pid=5630): Terminated {rc=256} 01:13:59.424210 --- ParallelTerminationStrategy: PID 5631 died... 01:13:59.442845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5631): Terminated: ok {rc=0} 01:13:59.487444 --- ParallelTerminationStrategy: PID 5632 died... 01:13:59.506124 run iperf3-srv_10.42.42.10(pid=5632): Terminated {rc=256} 01:13:59.550562 --- ParallelTerminationStrategy: PID 5635 died... 01:13:59.569326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5635): Terminated: ok {rc=0} 01:13:59.613855 --- ParallelTerminationStrategy: PID 5638 died... 01:13:59.632615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5638): Terminated: ok {rc=0} 01:13:59.677138 --- ParallelTerminationStrategy: PID 5641 died... 01:13:59.695703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5641): Terminated: ok {rc=0} 01:13:59.780629 bus /gobi_0: Setting Powered False 01:14:00.896528 bus /gobi_0: Setting Powered False 01:14:02.024348 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:14:03.178403 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:03.190731 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:14:03.309586 tst iperf3.py: using LAC 18042 01:14:03.439940 tst iperf3.py: using RAC 192 01:14:03.572839 tst iperf3.py: using CellId 18042 01:14:03.700358 tst iperf3.py: using BVCI 18043 01:14:03.819068 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:03.830735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:03.842221 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:03.853900 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:03.865491 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:03.877430 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:03.889373 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:03.900724 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:03.912509 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:04.030520 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:14:04.236383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:04.544276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5644): Launched 01:14:04.812196 run iperf3-srv_10.42.42.10(pid=5645): Launched 01:14:04.927613 tst iperf3.py:8: start network... 01:14:05.132725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:05.607551 run create_hlr_db(pid=5646): Launched 01:14:05.725880 bus /gobi_6: Setting Powered False 01:14:06.786511 run create_hlr_db(pid=5646): Terminated: ok {rc=0} 01:14:07.236153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5648): Launched 01:14:07.565688 run osmo-hlr_10.42.42.2(pid=5649): Launched 01:14:07.693893 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:08.266971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5651): Launched 01:14:08.598958 run osmo-stp_10.42.42.5(pid=5652): Launched 01:14:08.724089 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:09.290878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5654): Launched 01:14:09.418633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:09.696441 run patchelf(pid=5655): Launched 01:14:09.880518 run osmo-stp_10.42.42.5(pid=5652): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5652)] 01:14:10.020777 run osmo-stp_10.42.42.5(pid=5652): stdout: | (launched: 2022-12-09_01:14:08.538994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:10.163536 run osmo-stp_10.42.42.5(pid=5652): stderr: | 20221209011408734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011408734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011408734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011408734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011408735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011408735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011408735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:10.305680 run osmo-stp_10.42.42.5(pid=5652): stdout: | (launched: 2022-12-09_01:14:08.538994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:10.442514 run osmo-stp_10.42.42.5(pid=5652): stderr: | 20221209011408734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011408734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011408734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011408734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011408735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011408735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011408735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:10.603062 run patchelf(pid=5655): Terminating (SIGINT) 01:14:10.789140 run patchelf(pid=5655): Terminated: ok {rc=0} 01:14:10.923176 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5652): Process ended prematurely: osmo-stp_10.42.42.5(pid=5652) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5652)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 01:14:10.933732 tst iperf3.py:8: Test FAILED (7.8 sec) 01:14:10.962821 run osmo-hlr_10.42.42.2(pid=5649): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5649)] 01:14:11.013905 run osmo-hlr_10.42.42.2(pid=5649): stdout: | (launched: 2022-12-09_01:14:07.506253) 01:14:11.067095 run osmo-hlr_10.42.42.2(pid=5649): stderr: | 20221209011407705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011407706 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011407706 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011407706 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011407706 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011407706 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011407718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011407727 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011407727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011407727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:11.120795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5644): Terminating (SIGTERM) 01:14:11.164248 run iperf3-srv_10.42.42.10(pid=5645): Terminating (SIGTERM) 01:14:11.207320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5648): Terminating (SIGTERM) 01:14:11.250172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5651): Terminating (SIGTERM) 01:14:11.293721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5654): Terminating (SIGTERM) 01:14:11.337444 --- ParallelTerminationStrategy: PID 5644 died... 01:14:11.357899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5644): Terminated: ok {rc=0} 01:14:11.405814 --- ParallelTerminationStrategy: PID 5645 died... 01:14:11.425956 run iperf3-srv_10.42.42.10(pid=5645): Terminated {rc=256} 01:14:11.473223 --- ParallelTerminationStrategy: PID 5648 died... 01:14:11.493172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5648): Terminated: ok {rc=0} 01:14:11.540436 --- ParallelTerminationStrategy: PID 5651 died... 01:14:11.560470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5651): Terminated: ok {rc=0} 01:14:11.607778 --- ParallelTerminationStrategy: PID 5654 died... 01:14:11.627930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5654): Terminated: ok {rc=0} 01:14:11.716661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:14:12.870874 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:12.883368 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:14:12.956479 tst iperf3m4.py: using LAC 18043 01:14:13.085162 tst iperf3m4.py: using RAC 193 01:14:13.214372 tst iperf3m4.py: using CellId 18043 01:14:13.344728 tst iperf3m4.py: using BVCI 18044 01:14:13.463761 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:13.475422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:13.486895 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:13.498647 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:13.510544 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:13.522296 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:13.534190 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:13.545761 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:13.557708 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:13.681168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:13.800256 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:13.922035 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:14.037269 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:14:14.261316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:14.593920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5656): Launched 01:14:14.883072 run iperf3-srv_10.42.42.10(pid=5657): Launched 01:14:15.009208 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:14:15.233550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:15.565597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5658): Launched 01:14:15.857695 run iperf3-srv_10.42.42.10(pid=5659): Launched 01:14:16.017510 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:14:16.233948 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:16.556482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5660): Launched 01:14:16.848702 run iperf3-srv_10.42.42.10(pid=5661): Launched 01:14:16.982877 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:14:17.196162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:17.506968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5662): Launched 01:14:17.777467 run iperf3-srv_10.42.42.10(pid=5663): Launched 01:14:17.894013 tst iperf3m4.py:8: start network... 01:14:18.100874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:18.578349 run create_hlr_db(pid=5664): Launched 01:14:18.695638 bus /gobi_6: Setting Powered False 01:14:19.757675 run create_hlr_db(pid=5664): Terminated: ok {rc=0} 01:14:20.185768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5666): Launched 01:14:20.496212 run osmo-hlr_10.42.42.2(pid=5667): Launched 01:14:20.614094 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:21.155255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5669): Launched 01:14:21.461913 run osmo-stp_10.42.42.5(pid=5670): Launched 01:14:21.578908 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:22.108222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5672): Launched 01:14:22.226806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:22.487250 run patchelf(pid=5673): Launched 01:14:22.660609 run osmo-stp_10.42.42.5(pid=5670): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5670)] 01:14:22.791188 run osmo-stp_10.42.42.5(pid=5670): stdout: | (launched: 2022-12-09_01:14:21.405936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:22.923403 run osmo-stp_10.42.42.5(pid=5670): stderr: | 20221209011421574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011421574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011421574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011421575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011421575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011421575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011421575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:23.055356 run osmo-stp_10.42.42.5(pid=5670): stdout: | (launched: 2022-12-09_01:14:21.405936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:23.181693 run osmo-stp_10.42.42.5(pid=5670): stderr: | 20221209011421574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011421574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011421574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011421575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011421575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011421575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011421575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:23.330789 run patchelf(pid=5673): Terminating (SIGINT) 01:14:23.503733 run patchelf(pid=5673): Terminated: ok {rc=0} 01:14:23.628603 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5670): Process ended prematurely: osmo-stp_10.42.42.5(pid=5670) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5670)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:14:23.638529 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:14:23.666899 run osmo-hlr_10.42.42.2(pid=5667): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5667)] 01:14:23.715420 run osmo-hlr_10.42.42.2(pid=5667): stdout: | (launched: 2022-12-09_01:14:20.439205) 01:14:23.765884 run osmo-hlr_10.42.42.2(pid=5667): stderr: | 20221209011420617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011420617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011420617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011420617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011420617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011420618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011420630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011420641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011420641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011420641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:23.816705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5656): Terminating (SIGTERM) 01:14:23.857360 run iperf3-srv_10.42.42.10(pid=5657): Terminating (SIGTERM) 01:14:23.897766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5658): Terminating (SIGTERM) 01:14:23.938408 run iperf3-srv_10.42.42.10(pid=5659): Terminating (SIGTERM) 01:14:23.978835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5660): Terminating (SIGTERM) 01:14:24.019553 run iperf3-srv_10.42.42.10(pid=5661): Terminating (SIGTERM) 01:14:24.060034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5662): Terminating (SIGTERM) 01:14:24.100651 run iperf3-srv_10.42.42.10(pid=5663): Terminating (SIGTERM) 01:14:24.141378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5666): Terminating (SIGTERM) 01:14:24.182035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5669): Terminating (SIGTERM) 01:14:24.222605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5672): Terminating (SIGTERM) 01:14:24.263325 --- ParallelTerminationStrategy: PID 5656 died... 01:14:24.282663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5656): Terminated: ok {rc=0} 01:14:24.328025 --- ParallelTerminationStrategy: PID 5657 died... 01:14:24.347015 run iperf3-srv_10.42.42.10(pid=5657): Terminated {rc=256} 01:14:24.392084 --- ParallelTerminationStrategy: PID 5658 died... 01:14:24.411132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5658): Terminated: ok {rc=0} 01:14:24.456225 --- ParallelTerminationStrategy: PID 5659 died... 01:14:24.475211 run iperf3-srv_10.42.42.10(pid=5659): Terminated {rc=256} 01:14:24.520428 --- ParallelTerminationStrategy: PID 5660 died... 01:14:24.539777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5660): Terminated: ok {rc=0} 01:14:24.590474 --- ParallelTerminationStrategy: PID 5661 died... 01:14:24.610305 run iperf3-srv_10.42.42.10(pid=5661): Terminated {rc=256} 01:14:24.657351 --- ParallelTerminationStrategy: PID 5662 died... 01:14:24.677425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5662): Terminated: ok {rc=0} 01:14:24.724309 --- ParallelTerminationStrategy: PID 5663 died... 01:14:24.744307 run iperf3-srv_10.42.42.10(pid=5663): Terminated {rc=256} 01:14:24.791256 --- ParallelTerminationStrategy: PID 5666 died... 01:14:24.811179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5666): Terminated: ok {rc=0} 01:14:24.858432 --- ParallelTerminationStrategy: PID 5669 died... 01:14:24.878469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5669): Terminated: ok {rc=0} 01:14:24.925650 --- ParallelTerminationStrategy: PID 5672 died... 01:14:24.945580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5672): Terminated: ok {rc=0} 01:14:25.034954 bus /gobi_4: Setting Powered False 01:14:26.135802 bus /gobi_4: Setting Powered False 01:14:27.253735 bus /gobi_1: Setting Powered False 01:14:28.354234 bus /gobi_1: Setting Powered False 01:14:29.471572 bus /gobi_0: Setting Powered False 01:14:30.571264 bus /gobi_0: Setting Powered False 01:14:31.692731 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:14:32.801273 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:32.813792 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:14:32.887398 tst ping.py: using LAC 18044 01:14:33.015836 tst ping.py: using RAC 194 01:14:33.141628 tst ping.py: using CellId 18044 01:14:33.270612 tst ping.py: using BVCI 18045 01:14:33.381358 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:33.392492 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:33.403627 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:33.415108 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:33.426270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:33.437482 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:33.448602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:33.459794 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:33.579426 tst ping.py:19: start network... 01:14:33.796568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:34.295045 run create_hlr_db(pid=5676): Launched 01:14:34.426032 bus /gobi_6: Setting Powered False 01:14:35.490093 run create_hlr_db(pid=5676): Terminated: ok {rc=0} 01:14:35.921356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5678): Launched 01:14:36.222877 run osmo-hlr_10.42.42.2(pid=5679): Launched 01:14:36.339766 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:36.873767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5681): Launched 01:14:37.174779 run osmo-stp_10.42.42.5(pid=5682): Launched 01:14:37.290070 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:37.809233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5684): Launched 01:14:37.925082 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:38.180254 run patchelf(pid=5685): Launched 01:14:38.349413 run osmo-stp_10.42.42.5(pid=5682): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5682)] 01:14:38.477392 run osmo-stp_10.42.42.5(pid=5682): stdout: | (launched: 2022-12-09_01:14:37.119626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:38.607310 run osmo-stp_10.42.42.5(pid=5682): stderr: | 20221209011437291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011437292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011437292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011437292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011437293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011437293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011437293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:38.737159 run osmo-stp_10.42.42.5(pid=5682): stdout: | (launched: 2022-12-09_01:14:37.119626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:38.860745 run osmo-stp_10.42.42.5(pid=5682): stderr: | 20221209011437291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011437292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011437292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011437292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011437293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011437293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011437293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:39.006941 run patchelf(pid=5685): Terminating (SIGINT) 01:14:39.176730 run patchelf(pid=5685): Terminated: ok {rc=0} 01:14:39.299679 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5682): Process ended prematurely: osmo-stp_10.42.42.5(pid=5682) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5682)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 01:14:39.308679 tst ping.py:22: Test FAILED (6.5 sec) 01:14:39.336532 run osmo-hlr_10.42.42.2(pid=5679): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5679)] 01:14:39.385149 run osmo-hlr_10.42.42.2(pid=5679): stdout: | (launched: 2022-12-09_01:14:36.167704) 01:14:39.435480 run osmo-hlr_10.42.42.2(pid=5679): stderr: | 20221209011436342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011436343 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011436343 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011436343 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011436343 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011436343 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011436355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011436364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011436364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011436364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:39.486305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5678): Terminating (SIGTERM) 01:14:39.526909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5681): Terminating (SIGTERM) 01:14:39.567375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5684): Terminating (SIGTERM) 01:14:39.608732 --- ParallelTerminationStrategy: PID 5678 died... 01:14:39.628245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5678): Terminated: ok {rc=0} 01:14:39.673690 --- ParallelTerminationStrategy: PID 5681 died... 01:14:39.692747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5681): Terminated: ok {rc=0} 01:14:39.737746 --- ParallelTerminationStrategy: PID 5684 died... 01:14:39.756613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5684): Terminated: ok {rc=0} 01:14:39.842220 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:14:40.929164 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:40.940941 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:14:41.012868 tst ping_idle_ping.py: using LAC 18045 01:14:41.131344 tst ping_idle_ping.py: using RAC 195 01:14:41.250974 tst ping_idle_ping.py: using CellId 18045 01:14:41.372132 tst ping_idle_ping.py: using BVCI 18046 01:14:41.483327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:41.494664 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:41.505850 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:41.517389 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:41.528565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:41.539930 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:41.551327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:41.562480 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:41.682671 tst ping_idle_ping.py:24: start network... 01:14:41.901764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:42.410828 run create_hlr_db(pid=5686): Launched 01:14:42.542709 bus /gobi_6: Setting Powered False 01:14:43.606845 run create_hlr_db(pid=5686): Terminated: ok {rc=0} 01:14:44.057502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5688): Launched 01:14:44.382439 run osmo-hlr_10.42.42.2(pid=5689): Launched 01:14:44.508494 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:45.067370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5691): Launched 01:14:45.390531 run osmo-stp_10.42.42.5(pid=5692): Launched 01:14:45.515755 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:46.089357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5694): Launched 01:14:46.221711 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:46.489205 run patchelf(pid=5695): Launched 01:14:46.679092 run osmo-stp_10.42.42.5(pid=5692): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5692)] 01:14:46.812480 run osmo-stp_10.42.42.5(pid=5692): stdout: | (launched: 2022-12-09_01:14:45.331931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:46.946844 run osmo-stp_10.42.42.5(pid=5692): stderr: | 20221209011445526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011445526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011445526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011445526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011445527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011445527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011445527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:47.081658 run osmo-stp_10.42.42.5(pid=5692): stdout: | (launched: 2022-12-09_01:14:45.331931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:47.209458 run osmo-stp_10.42.42.5(pid=5692): stderr: | 20221209011445526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011445526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011445526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011445526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011445527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011445527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011445527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:47.356512 run patchelf(pid=5695): Terminating (SIGINT) 01:14:47.526998 run patchelf(pid=5695): Terminated: ok {rc=0} 01:14:47.649340 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5692): Process ended prematurely: osmo-stp_10.42.42.5(pid=5692) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5692)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:14:47.658644 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:14:47.686622 run osmo-hlr_10.42.42.2(pid=5689): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5689)] 01:14:47.735337 run osmo-hlr_10.42.42.2(pid=5689): stdout: | (launched: 2022-12-09_01:14:44.323320) 01:14:47.785235 run osmo-hlr_10.42.42.2(pid=5689): stderr: | 20221209011444521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011444521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011444521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011444521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011444521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011444521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011444535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011444544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011444544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011444544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:47.835769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5688): Terminating (SIGTERM) 01:14:47.876035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5691): Terminating (SIGTERM) 01:14:47.916331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5694): Terminating (SIGTERM) 01:14:47.956934 --- ParallelTerminationStrategy: PID 5688 died... 01:14:47.976196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5688): Terminated: ok {rc=0} 01:14:48.021175 --- ParallelTerminationStrategy: PID 5691 died... 01:14:48.039953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5691): Terminated: ok {rc=0} 01:14:48.084579 --- ParallelTerminationStrategy: PID 5694 died... 01:14:48.103466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5694): Terminated: ok {rc=0} 01:14:48.187513 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:14:49.499162 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:14:49.506223 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:14:49.542512 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:14:49.582873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:14:49.673233 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:14:49.708001 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:14:49.746641 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:14:50.346478 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:14:50.400934 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:50.412540 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:14:50.486930 tst cs_paging_gprs_active.py: using LAC 18046 01:14:50.615647 tst cs_paging_gprs_active.py: using RAC 196 01:14:50.747897 tst cs_paging_gprs_active.py: using CellId 18046 01:14:50.869439 tst cs_paging_gprs_active.py: using BVCI 18047 01:14:50.989628 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.001211 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.012629 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.024069 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.035487 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.046882 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.058346 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.069679 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.081251 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:51.198210 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:51.316657 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:14:51.523542 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:51.833357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5700): Launched 01:14:52.101750 run iperf3-srv_10.42.42.10(pid=5701): Launched 01:14:52.218316 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:14:52.425558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:52.737022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5702): Launched 01:14:53.007380 run iperf3-srv_10.42.42.10(pid=5703): Launched 01:14:53.123218 tst cs_paging_gprs_active.py:38: start network... 01:14:53.329778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:53.805791 run create_hlr_db(pid=5704): Launched 01:14:53.924728 bus /gobi_6: Setting Powered False 01:14:54.986044 run create_hlr_db(pid=5704): Terminated: ok {rc=0} 01:14:55.435639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5706): Launched 01:14:55.765437 run osmo-hlr_10.42.42.2(pid=5707): Launched 01:14:55.893638 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:56.461332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5709): Launched 01:14:56.793001 run osmo-stp_10.42.42.5(pid=5710): Launched 01:14:56.918941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:57.487315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5712): Launched 01:14:57.615643 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:57.894282 run patchelf(pid=5713): Launched 01:14:58.078825 run osmo-stp_10.42.42.5(pid=5710): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5710)] 01:14:58.218799 run osmo-stp_10.42.42.5(pid=5710): stdout: | (launched: 2022-12-09_01:14:56.732294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:58.360883 run osmo-stp_10.42.42.5(pid=5710): stderr: | 20221209011456927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011456927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011456927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011456928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011456928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011456928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011456928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:58.502666 run osmo-stp_10.42.42.5(pid=5710): stdout: | (launched: 2022-12-09_01:14:56.732294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:58.637865 run osmo-stp_10.42.42.5(pid=5710): stderr: | 20221209011456927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011456927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011456927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011456928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011456928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011456928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011456928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:58.798201 run patchelf(pid=5713): Terminating (SIGINT) 01:14:58.982806 run patchelf(pid=5713): Terminated: ok {rc=0} 01:14:59.116164 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5710): Process ended prematurely: osmo-stp_10.42.42.5(pid=5710) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5710)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:14:59.126546 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:14:59.155582 run osmo-hlr_10.42.42.2(pid=5707): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5707)] 01:14:59.206536 run osmo-hlr_10.42.42.2(pid=5707): stdout: | (launched: 2022-12-09_01:14:55.705785) 01:14:59.259131 run osmo-hlr_10.42.42.2(pid=5707): stderr: | 20221209011455906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011455906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011455907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011455907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011455907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011455907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011455919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011455928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011455928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011455928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:59.312142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5700): Terminating (SIGTERM) 01:14:59.354745 run iperf3-srv_10.42.42.10(pid=5701): Terminating (SIGTERM) 01:14:59.396823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5702): Terminating (SIGTERM) 01:14:59.438998 run iperf3-srv_10.42.42.10(pid=5703): Terminating (SIGTERM) 01:14:59.482563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5706): Terminating (SIGTERM) 01:14:59.524859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5709): Terminating (SIGTERM) 01:14:59.566959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5712): Terminating (SIGTERM) 01:14:59.609424 --- ParallelTerminationStrategy: PID 5700 died... 01:14:59.629635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5700): Terminated: ok {rc=0} 01:14:59.676364 --- ParallelTerminationStrategy: PID 5701 died... 01:14:59.696014 run iperf3-srv_10.42.42.10(pid=5701): Terminated {rc=256} 01:14:59.742166 --- ParallelTerminationStrategy: PID 5702 died... 01:14:59.761739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5702): Terminated: ok {rc=0} 01:14:59.807875 --- ParallelTerminationStrategy: PID 5703 died... 01:14:59.827391 run iperf3-srv_10.42.42.10(pid=5703): Terminated {rc=256} 01:14:59.873525 --- ParallelTerminationStrategy: PID 5706 died... 01:14:59.893119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5706): Terminated: ok {rc=0} 01:14:59.939428 --- ParallelTerminationStrategy: PID 5709 died... 01:14:59.959090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5709): Terminated: ok {rc=0} 01:15:00.005461 --- ParallelTerminationStrategy: PID 5712 died... 01:15:00.025127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5712): Terminated: ok {rc=0} 01:15:00.113153 bus /gobi_0: Setting Powered False 01:15:01.217319 bus /gobi_0: Setting Powered False 01:15:02.346604 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:15:03.497766 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:03.510043 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:15:03.586370 tst iperf3.py: using LAC 18047 01:15:03.715773 tst iperf3.py: using RAC 197 01:15:03.843535 tst iperf3.py: using CellId 18047 01:15:03.971919 tst iperf3.py: using BVCI 18048 01:15:04.091052 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:04.102685 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:04.114089 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:04.125495 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:04.136788 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:04.148239 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:04.159663 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:04.171236 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:04.182769 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:04.302110 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:15:04.509742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:15:04.817333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5717): Launched 01:15:05.086705 run iperf3-srv_10.42.42.10(pid=5718): Launched 01:15:05.202619 tst iperf3.py:8: start network... 01:15:05.409042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:05.884683 run create_hlr_db(pid=5719): Launched 01:15:06.003139 bus /gobi_6: Setting Powered False 01:15:07.063502 run create_hlr_db(pid=5719): Terminated: ok {rc=0} 01:15:07.513147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5721): Launched 01:15:07.843250 run osmo-hlr_10.42.42.2(pid=5722): Launched 01:15:07.970827 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:08.538825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5724): Launched 01:15:08.870109 run osmo-stp_10.42.42.5(pid=5725): Launched 01:15:08.997876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:09.566179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5727): Launched 01:15:09.694110 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:09.973270 run patchelf(pid=5728): Launched 01:15:10.157292 run osmo-stp_10.42.42.5(pid=5725): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5725)] 01:15:10.298075 run osmo-stp_10.42.42.5(pid=5725): stdout: | (launched: 2022-12-09_01:15:08.809995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:10.439970 run osmo-stp_10.42.42.5(pid=5725): stderr: | 20221209011509002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011509002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011509002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011509003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011509004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011509004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011509004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:10.581391 run osmo-stp_10.42.42.5(pid=5725): stdout: | (launched: 2022-12-09_01:15:08.809995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:10.716792 run osmo-stp_10.42.42.5(pid=5725): stderr: | 20221209011509002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011509002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011509002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011509003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011509004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011509004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011509004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:10.877598 run patchelf(pid=5728): Terminating (SIGINT) 01:15:11.063335 run patchelf(pid=5728): Terminated: ok {rc=0} 01:15:11.197388 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5725): Process ended prematurely: osmo-stp_10.42.42.5(pid=5725) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5725)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 01:15:11.207661 tst iperf3.py:8: Test FAILED (7.7 sec) 01:15:11.236680 run osmo-hlr_10.42.42.2(pid=5722): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5722)] 01:15:11.287470 run osmo-hlr_10.42.42.2(pid=5722): stdout: | (launched: 2022-12-09_01:15:07.783652) 01:15:11.339944 run osmo-hlr_10.42.42.2(pid=5722): stderr: | 20221209011507981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011507982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011507982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011507982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011507982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011507982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011507994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011508005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011508006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011508006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:11.392913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5717): Terminating (SIGTERM) 01:15:11.435594 run iperf3-srv_10.42.42.10(pid=5718): Terminating (SIGTERM) 01:15:11.478277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5721): Terminating (SIGTERM) 01:15:11.521157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5724): Terminating (SIGTERM) 01:15:11.563634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5727): Terminating (SIGTERM) 01:15:11.606671 --- ParallelTerminationStrategy: PID 5717 died... 01:15:11.627147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5717): Terminated: ok {rc=0} 01:15:11.674214 --- ParallelTerminationStrategy: PID 5718 died... 01:15:11.694204 run iperf3-srv_10.42.42.10(pid=5718): Terminated {rc=256} 01:15:11.741154 --- ParallelTerminationStrategy: PID 5721 died... 01:15:11.760847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5721): Terminated: ok {rc=0} 01:15:11.807621 --- ParallelTerminationStrategy: PID 5724 died... 01:15:11.827636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5724): Terminated: ok {rc=0} 01:15:11.874105 --- ParallelTerminationStrategy: PID 5727 died... 01:15:11.894050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5727): Terminated: ok {rc=0} 01:15:11.982758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:15:13.131188 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:13.142981 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:15:13.214941 tst iperf3m4.py: using LAC 18048 01:15:13.340200 tst iperf3m4.py: using RAC 198 01:15:13.458464 tst iperf3m4.py: using CellId 18048 01:15:13.578951 tst iperf3m4.py: using BVCI 18049 01:15:13.689977 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:13.700920 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:13.711888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:13.723040 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:13.734178 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:13.745325 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:13.756553 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:13.767883 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:13.779118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:13.895552 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:14.019164 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:14.139319 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:14.257055 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:15:14.464414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:15:14.773100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5729): Launched 01:15:15.042875 run iperf3-srv_10.42.42.10(pid=5730): Launched 01:15:15.159255 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:15:15.366152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:15:15.675194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5731): Launched 01:15:15.977609 run iperf3-srv_10.42.42.10(pid=5732): Launched 01:15:16.142435 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:15:16.409771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:15:16.752746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5733): Launched 01:15:17.057864 run iperf3-srv_10.42.42.10(pid=5734): Launched 01:15:17.198033 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:15:17.423198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:15:17.754902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5735): Launched 01:15:18.044594 run iperf3-srv_10.42.42.10(pid=5736): Launched 01:15:18.168130 tst iperf3m4.py:8: start network... 01:15:18.391272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:18.902448 run create_hlr_db(pid=5737): Launched 01:15:19.037496 bus /gobi_6: Setting Powered False 01:15:20.102914 run create_hlr_db(pid=5737): Terminated: ok {rc=0} 01:15:20.561282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5739): Launched 01:15:20.891509 run osmo-hlr_10.42.42.2(pid=5740): Launched 01:15:21.018091 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:21.583716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5742): Launched 01:15:21.913565 run osmo-stp_10.42.42.5(pid=5743): Launched 01:15:22.039009 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:22.606840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5745): Launched 01:15:22.734645 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:23.012457 run patchelf(pid=5746): Launched 01:15:23.197477 run osmo-stp_10.42.42.5(pid=5743): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5743)] 01:15:23.337317 run osmo-stp_10.42.42.5(pid=5743): stdout: | (launched: 2022-12-09_01:15:21.853554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:23.478228 run osmo-stp_10.42.42.5(pid=5743): stderr: | 20221209011522046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011522046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011522046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011522047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011522047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011522047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011522047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:23.619300 run osmo-stp_10.42.42.5(pid=5743): stdout: | (launched: 2022-12-09_01:15:21.853554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:23.754215 run osmo-stp_10.42.42.5(pid=5743): stderr: | 20221209011522046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011522046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011522046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011522047 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011522047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011522047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011522047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:23.914155 run patchelf(pid=5746): Terminating (SIGINT) 01:15:24.098005 run patchelf(pid=5746): Terminated: ok {rc=0} 01:15:24.231172 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5743): Process ended prematurely: osmo-stp_10.42.42.5(pid=5743) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5743)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:15:24.241586 tst iperf3m4.py:8: Test FAILED (11.1 sec) 01:15:24.270901 run osmo-hlr_10.42.42.2(pid=5740): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5740)] 01:15:24.321935 run osmo-hlr_10.42.42.2(pid=5740): stdout: | (launched: 2022-12-09_01:15:20.831205) 01:15:24.374739 run osmo-hlr_10.42.42.2(pid=5740): stderr: | 20221209011521031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011521031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011521031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011521031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011521031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011521031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011521046 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011521054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011521055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011521055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:24.428222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5729): Terminating (SIGTERM) 01:15:24.471000 run iperf3-srv_10.42.42.10(pid=5730): Terminating (SIGTERM) 01:15:24.513784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5731): Terminating (SIGTERM) 01:15:24.557150 run iperf3-srv_10.42.42.10(pid=5732): Terminating (SIGTERM) 01:15:24.599813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5733): Terminating (SIGTERM) 01:15:24.642637 run iperf3-srv_10.42.42.10(pid=5734): Terminating (SIGTERM) 01:15:24.685299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5735): Terminating (SIGTERM) 01:15:24.728008 run iperf3-srv_10.42.42.10(pid=5736): Terminating (SIGTERM) 01:15:24.770596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5739): Terminating (SIGTERM) 01:15:24.813465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5742): Terminating (SIGTERM) 01:15:24.856178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5745): Terminating (SIGTERM) 01:15:24.899253 --- ParallelTerminationStrategy: PID 5729 died... 01:15:24.919784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5729): Terminated: ok {rc=0} 01:15:24.967277 --- ParallelTerminationStrategy: PID 5730 died... 01:15:24.987477 run iperf3-srv_10.42.42.10(pid=5730): Terminated {rc=256} 01:15:25.033917 --- ParallelTerminationStrategy: PID 5731 died... 01:15:25.053908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5731): Terminated: ok {rc=0} 01:15:25.100903 --- ParallelTerminationStrategy: PID 5732 died... 01:15:25.121013 run iperf3-srv_10.42.42.10(pid=5732): Terminated {rc=256} 01:15:25.167697 --- ParallelTerminationStrategy: PID 5733 died... 01:15:25.187702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5733): Terminated: ok {rc=0} 01:15:25.235035 --- ParallelTerminationStrategy: PID 5734 died... 01:15:25.254986 run iperf3-srv_10.42.42.10(pid=5734): Terminated {rc=256} 01:15:25.301527 --- ParallelTerminationStrategy: PID 5735 died... 01:15:25.321542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5735): Terminated: ok {rc=0} 01:15:25.368400 --- ParallelTerminationStrategy: PID 5736 died... 01:15:25.388317 run iperf3-srv_10.42.42.10(pid=5736): Terminated {rc=256} 01:15:25.435029 --- ParallelTerminationStrategy: PID 5739 died... 01:15:25.454813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5739): Terminated: ok {rc=0} 01:15:25.501439 --- ParallelTerminationStrategy: PID 5742 died... 01:15:25.521187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5742): Terminated: ok {rc=0} 01:15:25.567833 --- ParallelTerminationStrategy: PID 5745 died... 01:15:25.587845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5745): Terminated: ok {rc=0} 01:15:25.677228 bus /gobi_4: Setting Powered False 01:15:26.778921 bus /gobi_4: Setting Powered False 01:15:27.897602 bus /gobi_1: Setting Powered False 01:15:28.994959 bus /gobi_1: Setting Powered False 01:15:30.112672 bus /gobi_0: Setting Powered False 01:15:31.214843 bus /gobi_0: Setting Powered False 01:15:32.336628 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:15:33.441661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:33.453604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:15:33.525609 tst ping.py: using LAC 18049 01:15:33.653364 tst ping.py: using RAC 199 01:15:33.780838 tst ping.py: using CellId 18049 01:15:33.909386 tst ping.py: using BVCI 18050 01:15:34.026506 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:34.038297 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:34.049864 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:34.062753 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:34.074634 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:34.086283 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:34.098339 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:34.109941 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:34.229657 tst ping.py:19: start network... 01:15:34.432318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:34.898523 run create_hlr_db(pid=5747): Launched 01:15:35.016543 bus /gobi_6: Setting Powered False 01:15:36.077545 run create_hlr_db(pid=5747): Terminated: ok {rc=0} 01:15:36.518873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5749): Launched 01:15:36.845040 run osmo-hlr_10.42.42.2(pid=5750): Launched 01:15:36.970004 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:37.537294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5752): Launched 01:15:37.859283 run osmo-stp_10.42.42.5(pid=5753): Launched 01:15:37.981554 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:38.539528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5755): Launched 01:15:38.664336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:38.936041 run patchelf(pid=5756): Launched 01:15:39.115254 run osmo-stp_10.42.42.5(pid=5753): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5753)] 01:15:39.252835 run osmo-stp_10.42.42.5(pid=5753): stdout: | (launched: 2022-12-09_01:15:37.800648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:39.391415 run osmo-stp_10.42.42.5(pid=5753): stderr: | 20221209011537991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011537992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011537992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011537992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011537993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011537993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011537993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:39.529830 run osmo-stp_10.42.42.5(pid=5753): stdout: | (launched: 2022-12-09_01:15:37.800648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:39.661458 run osmo-stp_10.42.42.5(pid=5753): stderr: | 20221209011537991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011537992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011537992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011537992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011537993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011537993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011537993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:39.817935 run patchelf(pid=5756): Terminating (SIGINT) 01:15:39.999153 run patchelf(pid=5756): Terminated: ok {rc=0} 01:15:40.129311 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5753): Process ended prematurely: osmo-stp_10.42.42.5(pid=5753) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5753)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 01:15:40.139037 tst ping.py:22: Test FAILED (6.7 sec) 01:15:40.167461 run osmo-hlr_10.42.42.2(pid=5750): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5750)] 01:15:40.218362 run osmo-hlr_10.42.42.2(pid=5750): stdout: | (launched: 2022-12-09_01:15:36.786140) 01:15:40.270501 run osmo-hlr_10.42.42.2(pid=5750): stderr: | 20221209011536984 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011536984 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011536984 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011536984 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011536984 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011536985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011536997 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011537006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011537007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011537007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:40.322832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5749): Terminating (SIGTERM) 01:15:40.364900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5752): Terminating (SIGTERM) 01:15:40.407158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5755): Terminating (SIGTERM) 01:15:40.449857 --- ParallelTerminationStrategy: PID 5749 died... 01:15:40.470210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5749): Terminated: ok {rc=0} 01:15:40.517269 --- ParallelTerminationStrategy: PID 5752 died... 01:15:40.536931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5752): Terminated: ok {rc=0} 01:15:40.583512 --- ParallelTerminationStrategy: PID 5755 died... 01:15:40.603395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5755): Terminated: ok {rc=0} 01:15:40.690922 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:15:41.779293 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:41.791672 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:15:41.865666 tst ping_idle_ping.py: using LAC 18050 01:15:42.014512 tst ping_idle_ping.py: using RAC 200 01:15:42.136515 tst ping_idle_ping.py: using CellId 18050 01:15:42.255612 tst ping_idle_ping.py: using BVCI 18051 01:15:42.365568 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:42.376790 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:42.387747 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:42.399004 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:42.410244 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:42.421363 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:42.432532 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:42.443603 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:42.558808 tst ping_idle_ping.py:24: start network... 01:15:42.778316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:43.283741 run create_hlr_db(pid=5757): Launched 01:15:43.417156 bus /gobi_6: Setting Powered False 01:15:44.482193 run create_hlr_db(pid=5757): Terminated: ok {rc=0} 01:15:44.933708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5759): Launched 01:15:45.261940 run osmo-hlr_10.42.42.2(pid=5760): Launched 01:15:45.386193 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:45.961710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5762): Launched 01:15:46.301240 run osmo-stp_10.42.42.5(pid=5763): Launched 01:15:46.550420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:47.192938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5765): Launched 01:15:47.317706 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:47.591888 run patchelf(pid=5766): Launched 01:15:47.772239 run osmo-stp_10.42.42.5(pid=5763): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5763)] 01:15:47.910104 run osmo-stp_10.42.42.5(pid=5763): stdout: | (launched: 2022-12-09_01:15:46.240293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:48.049663 run osmo-stp_10.42.42.5(pid=5763): stderr: | 20221209011546542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011546542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011546542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011546543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011546543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011546543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011546543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:48.189371 run osmo-stp_10.42.42.5(pid=5763): stdout: | (launched: 2022-12-09_01:15:46.240293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:48.322010 run osmo-stp_10.42.42.5(pid=5763): stderr: | 20221209011546542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011546542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011546542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011546543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011546543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011546543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011546543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:48.479840 run patchelf(pid=5766): Terminating (SIGINT) 01:15:48.662258 run patchelf(pid=5766): Terminated: ok {rc=0} 01:15:48.794118 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5763): Process ended prematurely: osmo-stp_10.42.42.5(pid=5763) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5763)] [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:15:48.804021 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 01:15:48.832468 run osmo-hlr_10.42.42.2(pid=5760): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5760)] 01:15:48.882930 run osmo-hlr_10.42.42.2(pid=5760): stdout: | (launched: 2022-12-09_01:15:45.202196) 01:15:48.934889 run osmo-hlr_10.42.42.2(pid=5760): stderr: | 20221209011545405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011545405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011545405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011545405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011545405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011545405 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011545417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011545426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011545426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011545426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:48.987369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5759): Terminating (SIGTERM) 01:15:49.029400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5762): Terminating (SIGTERM) 01:15:49.071358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5765): Terminating (SIGTERM) 01:15:49.113674 --- ParallelTerminationStrategy: PID 5759 died... 01:15:49.133693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5759): Terminated: ok {rc=0} 01:15:49.180546 --- ParallelTerminationStrategy: PID 5762 died... 01:15:49.200610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5762): Terminated: ok {rc=0} 01:15:49.247148 --- ParallelTerminationStrategy: PID 5765 died... 01:15:49.266920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5765): Terminated: ok {rc=0} 01:15:49.355472 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:15:50.664100 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:15:50.671861 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:15:50.706847 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:15:50.742550 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:15:50.797718 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:15:50.832016 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:15:50.867179 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:15:51.427691 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:15:51.433328 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:51.445119 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:15:51.522382 tst switch_tch_pdch.py: using LAC 18051 01:15:51.648843 tst switch_tch_pdch.py: using RAC 201 01:15:51.773136 tst switch_tch_pdch.py: using CellId 18051 01:15:51.897574 tst switch_tch_pdch.py: using BVCI 18052 01:15:52.014237 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:52.026152 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:52.037871 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:52.049651 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:52.061354 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:52.072927 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:52.084843 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:52.096611 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:15:52.213663 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:15:52.331143 tst switch_tch_pdch.py:51: start network... 01:15:52.535177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:53.002534 run create_hlr_db(pid=5770): Launched 01:15:53.121494 bus /gobi_6: Setting Powered False 01:15:54.181777 run create_hlr_db(pid=5770): Terminated: ok {rc=0} 01:15:54.628146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5772): Launched 01:15:54.951935 run osmo-hlr_10.42.42.2(pid=5773): Launched 01:15:55.075516 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:55.632853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5775): Launched 01:15:55.955080 run osmo-stp_10.42.42.5(pid=5776): Launched 01:15:56.078536 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:56.636095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5778): Launched 01:15:56.759952 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:57.033067 run patchelf(pid=5779): Launched 01:15:57.213580 run osmo-stp_10.42.42.5(pid=5776): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5776)] 01:15:57.351573 run osmo-stp_10.42.42.5(pid=5776): stdout: | (launched: 2022-12-09_01:15:55.896305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:57.490661 run osmo-stp_10.42.42.5(pid=5776): stderr: | 20221209011556089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011556089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011556090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011556090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011556090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011556090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011556090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:57.629831 run osmo-stp_10.42.42.5(pid=5776): stdout: | (launched: 2022-12-09_01:15:55.896305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:57.762321 run osmo-stp_10.42.42.5(pid=5776): stderr: | 20221209011556089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011556089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011556090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011556090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011556090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011556090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011556090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:57.919086 run patchelf(pid=5779): Terminating (SIGINT) 01:15:58.099896 run patchelf(pid=5779): Terminated: ok {rc=0} 01:15:58.230546 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5776): Process ended prematurely: osmo-stp_10.42.42.5(pid=5776) [trial-2352↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5776)] [trial-2352↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:15:58.240326 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 01:15:58.268753 run osmo-hlr_10.42.42.2(pid=5773): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5773)] 01:15:58.319902 run osmo-hlr_10.42.42.2(pid=5773): stdout: | (launched: 2022-12-09_01:15:54.892600) 01:15:58.372886 run osmo-hlr_10.42.42.2(pid=5773): stderr: | 20221209011555093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011555093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011555093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011555093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011555093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011555093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011555105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011555113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011555114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011555114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:58.426288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5772): Terminating (SIGTERM) 01:15:58.468876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5775): Terminating (SIGTERM) 01:15:58.511742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5778): Terminating (SIGTERM) 01:15:58.554897 --- ParallelTerminationStrategy: PID 5772 died... 01:15:58.575366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5772): Terminated: ok {rc=0} 01:15:58.622889 --- ParallelTerminationStrategy: PID 5775 died... 01:15:58.643039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5775): Terminated: ok {rc=0} 01:15:58.690291 --- ParallelTerminationStrategy: PID 5778 died... 01:15:58.710326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5778): Terminated: ok {rc=0} 01:15:58.799281 bus /gobi_0: Setting Powered False 01:15:59.899537 bus /gobi_0: Setting Powered False 01:16:01.030375 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:16:02.295362 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:02.301388 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:16:02.335962 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:16:02.371003 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:16:02.425443 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:16:02.459534 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:16:02.493817 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:16:03.048452 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:16:03.053594 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:16:03.064508 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:16:03.134357 tst switch_tch_pdch.py: using LAC 18052 01:16:03.255958 tst switch_tch_pdch.py: using RAC 202 01:16:03.374845 tst switch_tch_pdch.py: using CellId 18052 01:16:03.496392 tst switch_tch_pdch.py: using BVCI 18053 01:16:03.607754 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:16:03.618825 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:16:03.629714 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:16:03.641055 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:16:03.651946 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:16:03.663000 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:16:03.674332 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:16:03.685453 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:16:03.804655 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:16:03.924000 tst switch_tch_pdch.py:51: start network... 01:16:04.142819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:04.614680 run create_hlr_db(pid=5783): Launched 01:16:04.747897 bus /gobi_6: Setting Powered False 01:16:05.811389 run create_hlr_db(pid=5783): Terminated: ok {rc=0} 01:16:06.218520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5785): Launched 01:16:06.521383 run osmo-hlr_10.42.42.2(pid=5786): Launched 01:16:06.639364 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:07.146556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5788): Launched 01:16:07.448562 run osmo-stp_10.42.42.5(pid=5789): Launched 01:16:07.565993 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:16:08.060124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5791): Launched 01:16:08.185183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:16:08.458264 run patchelf(pid=5792): Launched 01:16:08.639026 run osmo-stp_10.42.42.5(pid=5789): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5789)] 01:16:08.775820 run osmo-stp_10.42.42.5(pid=5789): stdout: | (launched: 2022-12-09_01:16:07.393273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:08.914201 run osmo-stp_10.42.42.5(pid=5789): stderr: | 20221209011607562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011607562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011607563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011607563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011607563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011607564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011607564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:09.052681 run osmo-stp_10.42.42.5(pid=5789): stdout: | (launched: 2022-12-09_01:16:07.393273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:09.184130 run osmo-stp_10.42.42.5(pid=5789): stderr: | 20221209011607562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011607562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011607563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011607563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011607563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011607564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011607564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:09.341750 run patchelf(pid=5792): Terminating (SIGINT) 01:16:09.522695 run patchelf(pid=5792): Terminated: ok {rc=0} 01:16:09.652843 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5789): Process ended prematurely: osmo-stp_10.42.42.5(pid=5789) [trial-2352↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5789)] [trial-2352↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:16:09.662501 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 01:16:09.690584 run osmo-hlr_10.42.42.2(pid=5786): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5786)] 01:16:09.741301 run osmo-hlr_10.42.42.2(pid=5786): stdout: | (launched: 2022-12-09_01:16:06.466169) 01:16:09.793394 run osmo-hlr_10.42.42.2(pid=5786): stderr: | 20221209011606644 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011606644 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011606644 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011606644 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011606644 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011606644 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011606657 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011606667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011606668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011606668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:09.846462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5785): Terminating (SIGTERM) 01:16:09.888696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5788): Terminating (SIGTERM) 01:16:09.932531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5791): Terminating (SIGTERM) 01:16:09.975560 --- ParallelTerminationStrategy: PID 5785 died... 01:16:09.995697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5785): Terminated: ok {rc=0} 01:16:10.043056 --- ParallelTerminationStrategy: PID 5788 died... 01:16:10.063056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5788): Terminated: ok {rc=0} 01:16:10.109681 --- ParallelTerminationStrategy: PID 5791 died... 01:16:10.129471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5791): Terminated: ok {rc=0} 01:16:10.217300 bus /gobi_0: Setting Powered False 01:16:11.316119 bus /gobi_0: Setting Powered False 01:16:12.434496 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_sms:trx-umtrx --------------------------------------------------------------------- 01:16:13.696550 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:13.700597 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:16:13.733878 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 01:16:13.740935 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 01:16:13.794522 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:16:13.827720 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 01:16:13.834668 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 01:16:14.373047 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 01:16:14.378144 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 01:16:14.389487 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 01:16:14.437675 tst mo_mt_sms.py: using LAC 18053 01:16:14.564889 tst mo_mt_sms.py: using RAC 203 01:16:14.683335 tst mo_mt_sms.py: using CellId 18053 01:16:14.803301 tst mo_mt_sms.py: using BVCI 18054 01:16:14.913806 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:16:15.033401 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:16:15.150094 tst mo_mt_sms.py:9: start nitb and bts... 01:16:15.371020 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:16:16.049902 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5796): Launched 01:16:16.389498 run osmo-nitb_10.42.42.2(pid=5797): Launched 01:16:16.578992 run osmo-nitb_10.42.42.2(pid=5797): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5797)] 01:16:16.727548 run osmo-nitb_10.42.42.2(pid=5797): stdout: | (launched: 2022-12-09_01:16:16.329918) 01:16:16.877609 run osmo-nitb_10.42.42.2(pid=5797): stderr: | (launched: 2022-12-09_01:16:16.378913) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:16:17.028000 run osmo-nitb_10.42.42.2(pid=5797): stdout: | (launched: 2022-12-09_01:16:16.329918) 01:16:17.171315 run osmo-nitb_10.42.42.2(pid=5797): stderr: | (launched: 2022-12-09_01:16:16.378913) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5797): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5797) [trial-2352↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5797)] 01:16:17.520770 tst osmo-nitb_10.42.42.2(pid=5797): stdout: | (launched: 2022-12-09_01:16:16.329918) 01:16:17.651990 tst osmo-nitb_10.42.42.2(pid=5797): stderr: | (launched: 2022-12-09_01:16:16.378913) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:16:17.806671 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=5797): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5797) [trial-2352↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5797)] [trial-2352↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 01:16:17.815945 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 01:16:17.823092 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5796): Terminating (SIGTERM) 01:16:18.035715 --- ParallelTerminationStrategy: PID 5796 died... 01:16:18.057549 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5796): Terminated: ok {rc=0} 01:16:18.147794 bus /sierra_3: Setting Powered False 01:16:19.249543 bus /sierra_3: Setting Powered False 01:16:20.369669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 sms:trx-umtrx --------------------------------------------------------------------- 01:16:21.567368 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:21.571558 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:16:21.605932 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:16:21.632609 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 01:16:21.685354 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:16:21.717319 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:16:21.743759 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 01:16:22.290182 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 01:16:22.295362 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:22.306066 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 01:16:22.353103 tst mo_mt_sms.py: using LAC 18054 01:16:22.471792 tst mo_mt_sms.py: using RAC 204 01:16:22.600342 tst mo_mt_sms.py: using CellId 18054 01:16:22.728441 tst mo_mt_sms.py: using BVCI 18055 01:16:22.845208 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:22.856389 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:22.867505 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:22.878644 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:22.889983 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:22.901111 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:16:23.019813 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:16:23.133682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:23.600569 run create_hlr_db(pid=5801): Launched 01:16:23.716866 bus /sierra_2: Setting Powered False 01:16:24.777617 run create_hlr_db(pid=5801): Terminated: ok {rc=0} 01:16:25.220171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5803): Launched 01:16:25.544472 run osmo-hlr_10.42.42.2(pid=5804): Launched 01:16:25.670200 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:26.229602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5806): Launched 01:16:26.556022 run osmo-stp_10.42.42.5(pid=5807): Launched 01:16:26.682095 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:27.267920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5809): Launched 01:16:27.592062 run osmo-msc_10.42.42.6(pid=5810): Launched 01:16:27.771987 run osmo-stp_10.42.42.5(pid=5807): ERR: Terminated: ERROR {rc=1} [trial-2352↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5807)] 01:16:27.908430 run osmo-stp_10.42.42.5(pid=5807): stdout: | (launched: 2022-12-09_01:16:26.497261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:28.045189 run osmo-stp_10.42.42.5(pid=5807): stderr: | 20221209011626692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011626692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011626693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011626693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011626693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011626694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011626694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:28.180455 run osmo-stp_10.42.42.5(pid=5807): stdout: | (launched: 2022-12-09_01:16:26.497261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:28.309459 run osmo-stp_10.42.42.5(pid=5807): stderr: | 20221209011626692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011626692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011626693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011626693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011626693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011626694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011626694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:28.463103 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5807): Process ended prematurely: osmo-stp_10.42.42.5(pid=5807) [trial-2352↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5807)] [trial-2352↪sms:trx-umtrx↪mo_mt_sms.py:16] 01:16:28.472002 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 01:16:28.499651 run osmo-hlr_10.42.42.2(pid=5804): ERR: Terminated: ERROR {rc=237} [trial-2352↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5804)] 01:16:28.550611 run osmo-hlr_10.42.42.2(pid=5804): stdout: | (launched: 2022-12-09_01:16:25.485465) 01:16:28.603091 run osmo-hlr_10.42.42.2(pid=5804): stderr: | 20221209011625684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011625684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011625685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011625685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011625685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011625685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011625697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011625706 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011625706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011625706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:28.676285 run osmo-msc_10.42.42.6(pid=5810): ERR: Terminated: ERROR {rc=2} [trial-2352↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5810)] 01:16:28.726902 run osmo-msc_10.42.42.6(pid=5810): stdout: | (launched: 2022-12-09_01:16:27.533067) 01:16:28.778940 run osmo-msc_10.42.42.6(pid=5810): stderr: | 20221209011627859 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011627859 DLGLOBAL DEBUG validating counter group 0x7f11bbab1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011627859 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011627859 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011627859 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011627859 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011627861 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011627862 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011627862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011627862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:28.831501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5803): Terminating (SIGTERM) 01:16:28.873899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5806): Terminating (SIGTERM) 01:16:28.916025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5809): Terminating (SIGTERM) 01:16:28.958691 --- ParallelTerminationStrategy: PID 5803 died... 01:16:28.978443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5803): Terminated: ok {rc=0} 01:16:29.025174 --- ParallelTerminationStrategy: PID 5806 died... 01:16:29.045006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5806): Terminated: ok {rc=0} 01:16:29.091408 --- ParallelTerminationStrategy: PID 5809 died... 01:16:29.111198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5809): Terminated: ok {rc=0} 01:16:29.200352 bus /sierra_3: Setting Powered False 01:16:30.301480 bus /sierra_3: Setting Powered False 01:16:31.430380 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 01:16:32.669184 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:32.673195 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:16:32.706663 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 01:16:32.713703 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 01:16:32.749710 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:16:32.782110 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 01:16:32.789437 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 01:16:33.310941 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2352 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 01:16:33.316384 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 01:16:33.327779 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 01:16:33.375829 tst assert_extension.py: using LAC 18055 01:16:33.494462 tst assert_extension.py: using RAC 205 01:16:33.615241 tst assert_extension.py: using CellId 18055 01:16:33.734466 tst assert_extension.py: using BVCI 18056 01:16:33.843560 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 01:16:33.962474 tst assert_extension.py:10: start nitb and bts... 01:16:34.171137 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:16:34.787098 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5815): Launched 01:16:35.088902 run osmo-nitb_10.42.42.2(pid=5816): Launched 01:16:35.257252 run osmo-nitb_10.42.42.2(pid=5816): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5816)] 01:16:35.392483 run osmo-nitb_10.42.42.2(pid=5816): stdout: | (launched: 2022-12-09_01:16:35.033816) 01:16:35.529471 run osmo-nitb_10.42.42.2(pid=5816): stderr: | (launched: 2022-12-09_01:16:35.078595) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:16:35.666905 run osmo-nitb_10.42.42.2(pid=5816): stdout: | (launched: 2022-12-09_01:16:35.033816) 01:16:35.798443 run osmo-nitb_10.42.42.2(pid=5816): stderr: | (launched: 2022-12-09_01:16:35.078595) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5816) [trial-2352↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5816)] 01:16:36.203526 tst osmo-nitb_10.42.42.2(pid=5816): stdout: | (launched: 2022-12-09_01:16:35.033816) 01:16:36.325623 tst osmo-nitb_10.42.42.2(pid=5816): stderr: | (launched: 2022-12-09_01:16:35.078595) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:16:36.469520 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5816) [trial-2352↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5816)] [trial-2352↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 01:16:36.478016 tst assert_extension.py:12: Test FAILED (3.2 sec) 01:16:36.484611 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5815): Terminating (SIGTERM) 01:16:36.694412 --- ParallelTerminationStrategy: PID 5815 died... 01:16:36.715465 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5815): Terminated: ok {rc=0} 01:16:36.800035 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 ussd:trx-umtrx --------------------------------------------------------------------- 01:16:37.971058 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:37.975081 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:16:38.007601 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:16:38.034878 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 01:16:38.070914 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:16:38.103694 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:16:38.129818 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 01:16:38.656579 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2352 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 01:16:38.661587 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:38.672015 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 01:16:38.720366 tst assert_extension.py: using LAC 18056 01:16:38.839283 tst assert_extension.py: using RAC 206 01:16:38.958794 tst assert_extension.py: using CellId 18056 01:16:39.076611 tst assert_extension.py: using BVCI 18057 01:16:39.185250 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:39.195724 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:39.206352 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:39.216926 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:39.227742 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:39.238448 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 01:16:39.357779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:39.829410 run create_hlr_db(pid=5820): Launched 01:16:39.960762 bus /sierra_2: Setting Powered False 01:16:41.024825 run create_hlr_db(pid=5820): Terminated: ok {rc=0} 01:16:41.456835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5822): Launched 01:16:41.760231 run osmo-hlr_10.42.42.2(pid=5823): Launched 01:16:41.876898 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:42.416504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5825): Launched 01:16:42.719094 run osmo-stp_10.42.42.5(pid=5826): Launched 01:16:42.834961 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:43.380876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5828): Launched 01:16:43.683352 run osmo-msc_10.42.42.6(pid=5829): Launched 01:16:43.852161 run osmo-stp_10.42.42.5(pid=5826): ERR: Terminated: ERROR {rc=1} [trial-2352↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5826)] 01:16:43.980293 run osmo-stp_10.42.42.5(pid=5826): stdout: | (launched: 2022-12-09_01:16:42.663546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:44.108704 run osmo-stp_10.42.42.5(pid=5826): stderr: | 20221209011642834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011642834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011642834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011642835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011642835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011642835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011642835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:44.234416 run osmo-stp_10.42.42.5(pid=5826): stdout: | (launched: 2022-12-09_01:16:42.663546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:44.354321 run osmo-stp_10.42.42.5(pid=5826): stderr: | 20221209011642834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011642834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011642834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011642835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011642835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011642835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011642835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:44.497847 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5826): Process ended prematurely: osmo-stp_10.42.42.5(pid=5826) [trial-2352↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5826)] [trial-2352↪ussd:trx-umtrx↪assert_extension.py:17] 01:16:44.506199 tst assert_extension.py:17: Test FAILED (5.8 sec) 01:16:44.533018 run osmo-hlr_10.42.42.2(pid=5823): ERR: Terminated: ERROR {rc=237} [trial-2352↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5823)] 01:16:44.581392 run osmo-hlr_10.42.42.2(pid=5823): stdout: | (launched: 2022-12-09_01:16:41.704593) 01:16:44.631613 run osmo-hlr_10.42.42.2(pid=5823): stderr: | 20221209011641880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011641880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011641880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011641880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011641880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011641880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011641892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011641901 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011641901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011641901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:44.701399 run osmo-msc_10.42.42.6(pid=5829): ERR: Terminated: ERROR {rc=2} [trial-2352↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5829)] 01:16:44.749606 run osmo-msc_10.42.42.6(pid=5829): stdout: | (launched: 2022-12-09_01:16:43.627904) 01:16:44.799408 run osmo-msc_10.42.42.6(pid=5829): stderr: | 20221209011643899 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011643899 DLGLOBAL DEBUG validating counter group 0x7f705bc38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011643899 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011643899 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011643900 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011643900 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011643902 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011643902 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011643903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011643903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:44.849888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5822): Terminating (SIGTERM) 01:16:44.890191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5825): Terminating (SIGTERM) 01:16:44.930784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5828): Terminating (SIGTERM) 01:16:44.971220 --- ParallelTerminationStrategy: PID 5822 died... 01:16:44.990524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5822): Terminated: ok {rc=0} 01:16:45.035212 --- ParallelTerminationStrategy: PID 5825 died... 01:16:45.053848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5825): Terminated: ok {rc=0} 01:16:45.098265 --- ParallelTerminationStrategy: PID 5828 died... 01:16:45.116904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5828): Terminated: ok {rc=0} 01:16:45.201719 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:16:46.439668 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:46.446638 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:16:46.482958 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:16:46.511367 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:16:46.563668 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:16:46.611727 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:16:46.648765 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:16:47.201462 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:16:47.261358 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:47.273651 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:16:47.348893 tst mo_mt_call.py: using LAC 18057 01:16:47.478235 tst mo_mt_call.py: using RAC 207 01:16:47.599332 tst mo_mt_call.py: using CellId 18057 01:16:47.719428 tst mo_mt_call.py: using BVCI 18058 01:16:47.832715 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:47.843841 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:47.854731 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:47.866406 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:47.878208 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:47.889815 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:48.010473 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:48.126843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:48.602152 run create_hlr_db(pid=5834): Launched 01:16:48.721936 bus /sierra_2: Setting Powered False 01:16:49.783285 run create_hlr_db(pid=5834): Terminated: ok {rc=0} 01:16:50.231673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5836): Launched 01:16:50.562188 run osmo-hlr_10.42.42.2(pid=5837): Launched 01:16:50.688812 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:51.256755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5839): Launched 01:16:51.585963 run osmo-stp_10.42.42.5(pid=5840): Launched 01:16:51.713949 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:52.309664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5842): Launched 01:16:52.639947 run osmo-msc_10.42.42.6(pid=5843): Launched 01:16:52.824068 run osmo-stp_10.42.42.5(pid=5840): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5840)] 01:16:52.962503 run osmo-stp_10.42.42.5(pid=5840): stdout: | (launched: 2022-12-09_01:16:51.526326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:53.101411 run osmo-stp_10.42.42.5(pid=5840): stderr: | 20221209011651719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011651719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011651720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011651720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011651720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011651721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011651721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:53.239291 run osmo-stp_10.42.42.5(pid=5840): stdout: | (launched: 2022-12-09_01:16:51.526326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:53.370310 run osmo-stp_10.42.42.5(pid=5840): stderr: | 20221209011651719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011651719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011651720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011651720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011651720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011651721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011651721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:53.527108 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5840): Process ended prematurely: osmo-stp_10.42.42.5(pid=5840) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5840)] [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:16:53.536734 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:16:53.565046 run osmo-hlr_10.42.42.2(pid=5837): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5837)] 01:16:53.615700 run osmo-hlr_10.42.42.2(pid=5837): stdout: | (launched: 2022-12-09_01:16:50.502127) 01:16:53.668152 run osmo-hlr_10.42.42.2(pid=5837): stderr: | 20221209011650701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011650701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011650701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011650701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011650701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011650701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011650715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011650723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011650724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011650724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:53.741849 run osmo-msc_10.42.42.6(pid=5843): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5843)] 01:16:53.792491 run osmo-msc_10.42.42.6(pid=5843): stdout: | (launched: 2022-12-09_01:16:52.579841) 01:16:53.844826 run osmo-msc_10.42.42.6(pid=5843): stderr: | 20221209011652903 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011652903 DLGLOBAL DEBUG validating counter group 0x7f3da3badc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011652903 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011652903 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011652904 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011652904 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011652906 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011652906 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011652906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011652906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:53.897439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5836): Terminating (SIGTERM) 01:16:53.939816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5839): Terminating (SIGTERM) 01:16:53.982112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5842): Terminating (SIGTERM) 01:16:54.024636 --- ParallelTerminationStrategy: PID 5836 died... 01:16:54.044899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5836): Terminated: ok {rc=0} 01:16:54.091825 --- ParallelTerminationStrategy: PID 5839 died... 01:16:54.111522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5839): Terminated: ok {rc=0} 01:16:54.158348 --- ParallelTerminationStrategy: PID 5842 died... 01:16:54.178269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5842): Terminated: ok {rc=0} 01:16:54.269789 bus /sierra_3: Setting Powered False 01:16:55.371214 bus /sierra_3: Setting Powered False 01:16:56.491468 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:16:57.640153 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:57.652111 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:16:57.721572 tst mo_mt_call_osmux.py: using LAC 18058 01:16:57.844482 tst mo_mt_call_osmux.py: using RAC 208 01:16:57.967317 tst mo_mt_call_osmux.py: using CellId 18058 01:16:58.089418 tst mo_mt_call_osmux.py: using BVCI 18059 01:16:58.200631 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:58.211901 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:58.222929 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:58.234237 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:58.245620 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:58.256665 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:58.374120 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:58.493064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:59.002692 run create_hlr_db(pid=5845): Launched 01:16:59.136472 bus /sierra_2: Setting Powered False 01:17:00.201064 run create_hlr_db(pid=5845): Terminated: ok {rc=0} 01:17:00.639844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5847): Launched 01:17:00.979779 run osmo-hlr_10.42.42.2(pid=5848): Launched 01:17:01.216059 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:01.941599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5853): Launched 01:17:02.341717 run osmo-stp_10.42.42.5(pid=5854): Launched 01:17:02.469821 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:03.068737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5856): Launched 01:17:03.397656 run osmo-msc_10.42.42.6(pid=5857): Launched 01:17:03.583854 run osmo-stp_10.42.42.5(pid=5854): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5854)] 01:17:03.722211 run osmo-stp_10.42.42.5(pid=5854): stdout: | (launched: 2022-12-09_01:17:02.281517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:03.861668 run osmo-stp_10.42.42.5(pid=5854): stderr: | 20221209011702474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011702475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011702475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011702475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011702476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011702476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011702476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:03.999341 run osmo-stp_10.42.42.5(pid=5854): stdout: | (launched: 2022-12-09_01:17:02.281517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:04.130155 run osmo-stp_10.42.42.5(pid=5854): stderr: | 20221209011702474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011702475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011702475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011702475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011702476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011702476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011702476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:04.287461 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5854): Process ended prematurely: osmo-stp_10.42.42.5(pid=5854) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5854)] [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:17:04.297121 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 01:17:04.324882 run osmo-hlr_10.42.42.2(pid=5848): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5848)] 01:17:04.375155 run osmo-hlr_10.42.42.2(pid=5848): stdout: | (launched: 2022-12-09_01:17:00.923091) 01:17:04.427223 run osmo-hlr_10.42.42.2(pid=5848): stderr: | 20221209011701266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011701266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011701266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011701266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011701266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011701266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011701283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011701292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011701301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011701301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:04.499740 run osmo-msc_10.42.42.6(pid=5857): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5857)] 01:17:04.549856 run osmo-msc_10.42.42.6(pid=5857): stdout: | (launched: 2022-12-09_01:17:03.338129) 01:17:04.601753 run osmo-msc_10.42.42.6(pid=5857): stderr: | 20221209011703661 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011703661 DLGLOBAL DEBUG validating counter group 0x7f415dbebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011703662 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011703662 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011703662 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011703662 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011703664 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011703664 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011703665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011703665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:04.653842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5847): Terminating (SIGTERM) 01:17:04.695469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5853): Terminating (SIGTERM) 01:17:04.737035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5856): Terminating (SIGTERM) 01:17:04.779121 --- ParallelTerminationStrategy: PID 5847 died... 01:17:04.799228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5847): Terminated: ok {rc=0} 01:17:04.845625 --- ParallelTerminationStrategy: PID 5853 died... 01:17:04.865247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5853): Terminated: ok {rc=0} 01:17:04.911393 --- ParallelTerminationStrategy: PID 5856 died... 01:17:04.930963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5856): Terminated: ok {rc=0} 01:17:05.019206 bus /sierra_3: Setting Powered False 01:17:06.119816 bus /sierra_3: Setting Powered False 01:17:07.236915 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:17:08.493593 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:17:08.501121 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:17:08.534783 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:17:08.562234 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:17:08.615609 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:17:08.648725 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:17:08.676046 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:17:09.229048 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:17:09.281684 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:09.293258 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:17:09.363791 tst mo_mt_call.py: using LAC 18059 01:17:09.492270 tst mo_mt_call.py: using RAC 209 01:17:09.620663 tst mo_mt_call.py: using CellId 18059 01:17:09.749266 tst mo_mt_call.py: using BVCI 18060 01:17:09.869099 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:09.880659 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:09.892119 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:09.903613 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:09.915149 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:09.926664 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:17:10.043139 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:17:10.161738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:10.670392 run create_hlr_db(pid=5863): Launched 01:17:10.803672 bus /sierra_2: Setting Powered False 01:17:11.869197 run create_hlr_db(pid=5863): Terminated: ok {rc=0} 01:17:12.326400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5865): Launched 01:17:12.654323 run osmo-hlr_10.42.42.2(pid=5866): Launched 01:17:12.780633 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:13.349217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5868): Launched 01:17:13.678280 run osmo-stp_10.42.42.5(pid=5869): Launched 01:17:13.805689 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:14.401277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5871): Launched 01:17:14.728132 run osmo-msc_10.42.42.6(pid=5872): Launched 01:17:14.911393 run osmo-stp_10.42.42.5(pid=5869): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5869)] 01:17:15.053580 run osmo-stp_10.42.42.5(pid=5869): stdout: | (launched: 2022-12-09_01:17:13.618853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:15.190329 run osmo-stp_10.42.42.5(pid=5869): stderr: | 20221209011713811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011713811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011713812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011713812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011713814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011713815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011713815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:15.327602 run osmo-stp_10.42.42.5(pid=5869): stdout: | (launched: 2022-12-09_01:17:13.618853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:15.458710 run osmo-stp_10.42.42.5(pid=5869): stderr: | 20221209011713811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011713811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011713812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011713812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011713814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011713815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011713815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:15.615159 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5869): Process ended prematurely: osmo-stp_10.42.42.5(pid=5869) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5869)] [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:17:15.624698 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:17:15.652905 run osmo-hlr_10.42.42.2(pid=5866): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5866)] 01:17:15.703888 run osmo-hlr_10.42.42.2(pid=5866): stdout: | (launched: 2022-12-09_01:17:12.594930) 01:17:15.755927 run osmo-hlr_10.42.42.2(pid=5866): stderr: | 20221209011712794 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011712794 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011712794 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011712794 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011712794 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011712794 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011712810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011712818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011712818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011712818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:15.828645 run osmo-msc_10.42.42.6(pid=5872): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5872)] 01:17:15.881750 run osmo-msc_10.42.42.6(pid=5872): stdout: | (launched: 2022-12-09_01:17:14.668603) 01:17:15.954197 run osmo-msc_10.42.42.6(pid=5872): stderr: | 20221209011714991 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011714991 DLGLOBAL DEBUG validating counter group 0x7fdaf93eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011714992 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011714992 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011714992 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011714992 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011714994 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011714994 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011714994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011714995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:16.007386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5865): Terminating (SIGTERM) 01:17:16.052832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5868): Terminating (SIGTERM) 01:17:16.096146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5871): Terminating (SIGTERM) 01:17:16.141077 --- ParallelTerminationStrategy: PID 5865 died... 01:17:16.161814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5865): Terminated: ok {rc=0} 01:17:16.210692 --- ParallelTerminationStrategy: PID 5868 died... 01:17:16.231306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5868): Terminated: ok {rc=0} 01:17:16.278756 --- ParallelTerminationStrategy: PID 5871 died... 01:17:16.299143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5871): Terminated: ok {rc=0} 01:17:16.390460 bus /sierra_3: Setting Powered False 01:17:17.491329 bus /sierra_3: Setting Powered False 01:17:18.610184 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:17:19.758239 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:19.770237 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:17:19.840433 tst mo_mt_call_osmux.py: using LAC 18060 01:17:19.963475 tst mo_mt_call_osmux.py: using RAC 210 01:17:20.096174 tst mo_mt_call_osmux.py: using CellId 18060 01:17:20.224772 tst mo_mt_call_osmux.py: using BVCI 18061 01:17:20.346226 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:20.357935 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:20.369290 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:20.380546 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:20.391992 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:20.403440 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:17:20.519691 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:17:20.640627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:21.118972 run create_hlr_db(pid=5874): Launched 01:17:21.237883 bus /sierra_2: Setting Powered False 01:17:22.299505 run create_hlr_db(pid=5874): Terminated: ok {rc=0} 01:17:22.749943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5876): Launched 01:17:23.082684 run osmo-hlr_10.42.42.2(pid=5877): Launched 01:17:23.209452 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:23.781656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5879): Launched 01:17:24.113013 run osmo-stp_10.42.42.5(pid=5880): Launched 01:17:24.239223 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:24.835779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5882): Launched 01:17:25.165475 run osmo-msc_10.42.42.6(pid=5883): Launched 01:17:25.352107 run osmo-stp_10.42.42.5(pid=5880): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5880)] 01:17:25.491214 run osmo-stp_10.42.42.5(pid=5880): stdout: | (launched: 2022-12-09_01:17:24.052538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:25.631007 run osmo-stp_10.42.42.5(pid=5880): stderr: | 20221209011724248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011724248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011724248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011724249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011724249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011724249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011724249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:25.769467 run osmo-stp_10.42.42.5(pid=5880): stdout: | (launched: 2022-12-09_01:17:24.052538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:25.901191 run osmo-stp_10.42.42.5(pid=5880): stderr: | 20221209011724248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011724248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011724248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011724249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011724249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011724249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011724249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:26.059270 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5880): Process ended prematurely: osmo-stp_10.42.42.5(pid=5880) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5880)] [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:17:26.068926 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:17:26.097284 run osmo-hlr_10.42.42.2(pid=5877): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5877)] 01:17:26.148062 run osmo-hlr_10.42.42.2(pid=5877): stdout: | (launched: 2022-12-09_01:17:23.022349) 01:17:26.200830 run osmo-hlr_10.42.42.2(pid=5877): stderr: | 20221209011723223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011723223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011723223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011723223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011723224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011723224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011723236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011723246 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011723247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011723247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:26.274666 run osmo-msc_10.42.42.6(pid=5883): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5883)] 01:17:26.325830 run osmo-msc_10.42.42.6(pid=5883): stdout: | (launched: 2022-12-09_01:17:25.105687) 01:17:26.378235 run osmo-msc_10.42.42.6(pid=5883): stderr: | 20221209011725432 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011725432 DLGLOBAL DEBUG validating counter group 0x7f958a7afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011725432 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011725432 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011725433 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011725433 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011725434 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011725435 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011725435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011725435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:26.430847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5876): Terminating (SIGTERM) 01:17:26.473193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5879): Terminating (SIGTERM) 01:17:26.515594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5882): Terminating (SIGTERM) 01:17:26.558381 --- ParallelTerminationStrategy: PID 5876 died... 01:17:26.578654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5876): Terminated: ok {rc=0} 01:17:26.625701 --- ParallelTerminationStrategy: PID 5879 died... 01:17:26.645507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5879): Terminated: ok {rc=0} 01:17:26.692041 --- ParallelTerminationStrategy: PID 5882 died... 01:17:26.712201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5882): Terminated: ok {rc=0} 01:17:26.799977 bus /sierra_3: Setting Powered False 01:17:27.899560 bus /sierra_3: Setting Powered False 01:17:29.018560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:17:30.271434 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:17:30.278908 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:17:30.312484 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:17:30.340089 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:17:30.392757 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:17:30.426065 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:17:30.453316 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:17:31.018048 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:17:31.083085 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:31.094616 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:17:31.168553 tst mo_mt_call.py: using LAC 18061 01:17:31.320912 tst mo_mt_call.py: using RAC 211 01:17:31.480423 tst mo_mt_call.py: using CellId 18061 01:17:31.610092 tst mo_mt_call.py: using BVCI 18062 01:17:31.761883 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:31.776927 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:31.793567 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:31.811260 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:31.827025 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:31.841853 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:17:31.993969 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:17:32.135448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:32.656028 run create_hlr_db(pid=5888): Launched 01:17:32.789526 bus /sierra_2: Setting Powered False 01:17:33.854177 run create_hlr_db(pid=5888): Terminated: ok {rc=0} 01:17:34.292507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5890): Launched 01:17:34.601654 run osmo-hlr_10.42.42.2(pid=5891): Launched 01:17:34.719307 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:35.264126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5893): Launched 01:17:35.573339 run osmo-stp_10.42.42.5(pid=5894): Launched 01:17:35.691348 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:36.257305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5897): Launched 01:17:36.565747 run osmo-msc_10.42.42.6(pid=5898): Launched 01:17:36.738639 run osmo-stp_10.42.42.5(pid=5894): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5894)] 01:17:36.870101 run osmo-stp_10.42.42.5(pid=5894): stdout: | (launched: 2022-12-09_01:17:35.516631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:37.001113 run osmo-stp_10.42.42.5(pid=5894): stderr: | 20221209011735689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011735689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011735689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011735690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011735690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011735690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011735690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:37.130079 run osmo-stp_10.42.42.5(pid=5894): stdout: | (launched: 2022-12-09_01:17:35.516631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:37.252664 run osmo-stp_10.42.42.5(pid=5894): stderr: | 20221209011735689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011735689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011735689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011735690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011735690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011735690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011735690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:37.400234 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5894): Process ended prematurely: osmo-stp_10.42.42.5(pid=5894) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5894)] [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:17:37.409483 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:17:37.436920 run osmo-hlr_10.42.42.2(pid=5891): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5891)] 01:17:37.485750 run osmo-hlr_10.42.42.2(pid=5891): stdout: | (launched: 2022-12-09_01:17:34.545521) 01:17:37.536115 run osmo-hlr_10.42.42.2(pid=5891): stderr: | 20221209011734725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011734725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011734725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011734725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011734725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011734725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011734736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011734746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011734746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011734746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:37.606506 run osmo-msc_10.42.42.6(pid=5898): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5898)] 01:17:37.654951 run osmo-msc_10.42.42.6(pid=5898): stdout: | (launched: 2022-12-09_01:17:36.509517) 01:17:37.705359 run osmo-msc_10.42.42.6(pid=5898): stderr: | 20221209011736782 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011736782 DLGLOBAL DEBUG validating counter group 0x7f50dc218c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011736782 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011736782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011736782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011736782 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011736784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011736784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011736785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011736785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:37.755912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5890): Terminating (SIGTERM) 01:17:37.796509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5893): Terminating (SIGTERM) 01:17:37.837239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5897): Terminating (SIGTERM) 01:17:37.878159 --- ParallelTerminationStrategy: PID 5890 died... 01:17:37.897435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5890): Terminated: ok {rc=0} 01:17:37.942528 --- ParallelTerminationStrategy: PID 5893 died... 01:17:37.961529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5893): Terminated: ok {rc=0} 01:17:38.006465 --- ParallelTerminationStrategy: PID 5897 died... 01:17:38.025594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5897): Terminated: ok {rc=0} 01:17:38.111916 bus /sierra_3: Setting Powered False 01:17:39.212844 bus /sierra_3: Setting Powered False 01:17:40.332167 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:17:41.483775 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:41.495967 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:17:41.571859 tst mo_mt_call_osmux.py: using LAC 18062 01:17:41.701130 tst mo_mt_call_osmux.py: using RAC 212 01:17:41.828052 tst mo_mt_call_osmux.py: using CellId 18062 01:17:41.955525 tst mo_mt_call_osmux.py: using BVCI 18063 01:17:42.076116 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:42.087775 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:42.099227 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:42.110741 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:42.122578 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:42.133984 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:17:42.253837 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:17:42.370546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:42.850283 run create_hlr_db(pid=5900): Launched 01:17:42.970616 bus /sierra_2: Setting Powered False 01:17:44.031461 run create_hlr_db(pid=5900): Terminated: ok {rc=0} 01:17:44.459643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5902): Launched 01:17:44.766804 run osmo-hlr_10.42.42.2(pid=5903): Launched 01:17:44.885677 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:45.425751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5905): Launched 01:17:45.733580 run osmo-stp_10.42.42.5(pid=5906): Launched 01:17:45.907654 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:46.685363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5908): Launched 01:17:47.009014 run osmo-msc_10.42.42.6(pid=5909): Launched 01:17:47.325445 run osmo-stp_10.42.42.5(pid=5906): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5906)] 01:17:47.491033 run osmo-stp_10.42.42.5(pid=5906): stdout: | (launched: 2022-12-09_01:17:45.677457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:47.623075 run osmo-stp_10.42.42.5(pid=5906): stderr: | 20221209011745865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011745865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011745865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011745865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011745866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011745866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011745866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:47.750993 run osmo-stp_10.42.42.5(pid=5906): stdout: | (launched: 2022-12-09_01:17:45.677457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:47.872653 run osmo-stp_10.42.42.5(pid=5906): stderr: | 20221209011745865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011745865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011745865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011745865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011745866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011745866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011745866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:48.018830 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5906): Process ended prematurely: osmo-stp_10.42.42.5(pid=5906) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5906)] [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:17:48.027922 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 01:17:48.055476 run osmo-hlr_10.42.42.2(pid=5903): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5903)] 01:17:48.104194 run osmo-hlr_10.42.42.2(pid=5903): stdout: | (launched: 2022-12-09_01:17:44.710778) 01:17:48.154888 run osmo-hlr_10.42.42.2(pid=5903): stderr: | 20221209011744885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011744885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011744885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011744886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011744886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011744886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011744898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011744909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011744909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011744909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:48.225131 run osmo-msc_10.42.42.6(pid=5909): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5909)] 01:17:48.273737 run osmo-msc_10.42.42.6(pid=5909): stdout: | (launched: 2022-12-09_01:17:46.952002) 01:17:48.324089 run osmo-msc_10.42.42.6(pid=5909): stderr: | 20221209011747478 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011747479 DLGLOBAL DEBUG validating counter group 0x7f58155d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011747479 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011747479 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011747479 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011747479 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011747482 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011747482 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011747482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011747482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:48.375159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5902): Terminating (SIGTERM) 01:17:48.415698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5905): Terminating (SIGTERM) 01:17:48.456316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5908): Terminating (SIGTERM) 01:17:48.497107 --- ParallelTerminationStrategy: PID 5902 died... 01:17:48.516458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5902): Terminated: ok {rc=0} 01:17:48.561766 --- ParallelTerminationStrategy: PID 5905 died... 01:17:48.580763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5905): Terminated: ok {rc=0} 01:17:48.625725 --- ParallelTerminationStrategy: PID 5908 died... 01:17:48.644518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5908): Terminated: ok {rc=0} 01:17:48.730749 bus /sierra_3: Setting Powered False 01:17:49.831503 bus /sierra_3: Setting Powered False 01:17:50.948554 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:17:52.200463 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:17:52.207697 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:17:52.241384 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:17:52.269492 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:17:52.321856 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:17:52.354943 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:17:52.382122 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:17:52.937060 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:17:52.989717 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:53.001374 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:17:53.071935 tst mo_mt_call.py: using LAC 18063 01:17:53.202255 tst mo_mt_call.py: using RAC 213 01:17:53.345845 tst mo_mt_call.py: using CellId 18063 01:17:53.479772 tst mo_mt_call.py: using BVCI 18064 01:17:53.595415 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:53.606843 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:53.618095 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:53.629965 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:53.641860 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:53.653726 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:17:53.768640 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:17:53.892338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:54.371203 run create_hlr_db(pid=5914): Launched 01:17:54.488095 bus /sierra_2: Setting Powered False 01:17:55.549715 run create_hlr_db(pid=5914): Terminated: ok {rc=0} 01:17:55.998039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5916): Launched 01:17:56.329202 run osmo-hlr_10.42.42.2(pid=5917): Launched 01:17:56.455619 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:57.023035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5919): Launched 01:17:57.355001 run osmo-stp_10.42.42.5(pid=5920): Launched 01:17:57.484152 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:58.081921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5922): Launched 01:17:58.413414 run osmo-msc_10.42.42.6(pid=5923): Launched 01:17:58.599217 run osmo-stp_10.42.42.5(pid=5920): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5920)] 01:17:58.738529 run osmo-stp_10.42.42.5(pid=5920): stdout: | (launched: 2022-12-09_01:17:57.294737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:58.877715 run osmo-stp_10.42.42.5(pid=5920): stderr: | 20221209011757490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011757490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011757490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011757490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011757491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011757491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011757491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:59.016027 run osmo-stp_10.42.42.5(pid=5920): stdout: | (launched: 2022-12-09_01:17:57.294737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:59.147423 run osmo-stp_10.42.42.5(pid=5920): stderr: | 20221209011757490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011757490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011757490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011757490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011757491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011757491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011757491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:59.305588 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5920): Process ended prematurely: osmo-stp_10.42.42.5(pid=5920) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5920)] [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:17:59.315450 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:17:59.343869 run osmo-hlr_10.42.42.2(pid=5917): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5917)] 01:17:59.394309 run osmo-hlr_10.42.42.2(pid=5917): stdout: | (launched: 2022-12-09_01:17:56.269136) 01:17:59.446374 run osmo-hlr_10.42.42.2(pid=5917): stderr: | 20221209011756471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011756471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011756471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011756471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011756471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011756472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011756484 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011756492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011756493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011756493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:59.518826 run osmo-msc_10.42.42.6(pid=5923): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5923)] 01:17:59.569299 run osmo-msc_10.42.42.6(pid=5923): stdout: | (launched: 2022-12-09_01:17:58.353340) 01:17:59.621467 run osmo-msc_10.42.42.6(pid=5923): stderr: | 20221209011758677 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011758677 DLGLOBAL DEBUG validating counter group 0x7f974f228c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011758677 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011758677 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011758678 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011758678 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011758679 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011758680 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011758680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011758680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:59.673671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5916): Terminating (SIGTERM) 01:17:59.715365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5919): Terminating (SIGTERM) 01:17:59.757268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5922): Terminating (SIGTERM) 01:17:59.799209 --- ParallelTerminationStrategy: PID 5916 died... 01:17:59.819278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5916): Terminated: ok {rc=0} 01:17:59.866096 --- ParallelTerminationStrategy: PID 5919 died... 01:17:59.885934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5919): Terminated: ok {rc=0} 01:17:59.932134 --- ParallelTerminationStrategy: PID 5922 died... 01:17:59.951952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5922): Terminated: ok {rc=0} 01:18:00.041696 bus /sierra_3: Setting Powered False 01:18:01.152001 bus /sierra_3: Setting Powered False 01:18:02.279162 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:18:03.430932 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:18:03.443251 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:18:03.515489 tst mo_mt_call_osmux.py: using LAC 18064 01:18:03.645672 tst mo_mt_call_osmux.py: using RAC 214 01:18:03.770351 tst mo_mt_call_osmux.py: using CellId 18064 01:18:03.890427 tst mo_mt_call_osmux.py: using BVCI 18065 01:18:04.003432 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:18:04.014557 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:18:04.025570 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:18:04.036683 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:18:04.048419 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:18:04.059542 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:18:04.178952 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:18:04.298402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:04.772885 run create_hlr_db(pid=5925): Launched 01:18:04.890526 bus /sierra_2: Setting Powered False 01:18:05.951416 run create_hlr_db(pid=5925): Terminated: ok {rc=0} 01:18:06.400829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5927): Launched 01:18:06.729256 run osmo-hlr_10.42.42.2(pid=5928): Launched 01:18:06.855844 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:07.422619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5930): Launched 01:18:07.753062 run osmo-stp_10.42.42.5(pid=5931): Launched 01:18:07.879893 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:08.474573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5933): Launched 01:18:08.803560 run osmo-msc_10.42.42.6(pid=5934): Launched 01:18:08.986368 run osmo-stp_10.42.42.5(pid=5931): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5931)] 01:18:09.128105 run osmo-stp_10.42.42.5(pid=5931): stdout: | (launched: 2022-12-09_01:18:07.693492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:09.267737 run osmo-stp_10.42.42.5(pid=5931): stderr: | 20221209011807887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011807887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011807888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011807888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011807888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011807889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011807889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:09.404925 run osmo-stp_10.42.42.5(pid=5931): stdout: | (launched: 2022-12-09_01:18:07.693492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:09.535690 run osmo-stp_10.42.42.5(pid=5931): stderr: | 20221209011807887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011807887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011807888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011807888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011807888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011807889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011807889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:09.692262 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5931): Process ended prematurely: osmo-stp_10.42.42.5(pid=5931) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5931)] [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:18:09.702206 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:18:09.730383 run osmo-hlr_10.42.42.2(pid=5928): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5928)] 01:18:09.780809 run osmo-hlr_10.42.42.2(pid=5928): stdout: | (launched: 2022-12-09_01:18:06.669472) 01:18:09.832895 run osmo-hlr_10.42.42.2(pid=5928): stderr: | 20221209011806871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011806871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011806871 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011806871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011806871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011806871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011806885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011806893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011806893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011806893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:09.905670 run osmo-msc_10.42.42.6(pid=5934): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5934)] 01:18:09.956030 run osmo-msc_10.42.42.6(pid=5934): stdout: | (launched: 2022-12-09_01:18:08.743524) 01:18:10.008533 run osmo-msc_10.42.42.6(pid=5934): stderr: | 20221209011809067 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011809067 DLGLOBAL DEBUG validating counter group 0x7f4a3bf9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011809067 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011809067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011809067 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011809067 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011809069 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011809070 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011809070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011809070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:10.061254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5927): Terminating (SIGTERM) 01:18:10.102856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5930): Terminating (SIGTERM) 01:18:10.144549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5933): Terminating (SIGTERM) 01:18:10.187029 --- ParallelTerminationStrategy: PID 5927 died... 01:18:10.207348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5927): Terminated: ok {rc=0} 01:18:10.254622 --- ParallelTerminationStrategy: PID 5930 died... 01:18:10.274389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5930): Terminated: ok {rc=0} 01:18:10.321162 --- ParallelTerminationStrategy: PID 5933 died... 01:18:10.340820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5933): Terminated: ok {rc=0} 01:18:10.428450 bus /sierra_3: Setting Powered False 01:18:11.527728 bus /sierra_3: Setting Powered False 01:18:12.647354 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:18:13.901872 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:18:13.908875 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:18:13.942416 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:18:13.970203 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:18:14.023006 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:18:14.056146 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:18:14.083349 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:18:14.636740 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:18:14.689148 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:14.700667 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:18:14.771609 tst mo_mt_call.py: using LAC 18065 01:18:14.900553 tst mo_mt_call.py: using RAC 215 01:18:15.029534 tst mo_mt_call.py: using CellId 18065 01:18:15.160162 tst mo_mt_call.py: using BVCI 18066 01:18:15.279504 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:15.291077 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:15.302433 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:15.314082 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:15.325679 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:15.337034 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:18:15.454087 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:18:15.573420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:16.096083 run create_hlr_db(pid=5939): Launched 01:18:16.258339 bus /sierra_2: Setting Powered False 01:18:17.322170 run create_hlr_db(pid=5939): Terminated: ok {rc=0} 01:18:17.781655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5941): Launched 01:18:18.114382 run osmo-hlr_10.42.42.2(pid=5942): Launched 01:18:18.241177 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:18.812755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5944): Launched 01:18:19.141369 run osmo-stp_10.42.42.5(pid=5945): Launched 01:18:19.270096 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:19.865777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5947): Launched 01:18:20.196116 run osmo-msc_10.42.42.6(pid=5948): Launched 01:18:20.380637 run osmo-stp_10.42.42.5(pid=5945): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5945)] 01:18:20.519048 run osmo-stp_10.42.42.5(pid=5945): stdout: | (launched: 2022-12-09_01:18:19.081647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:20.657722 run osmo-stp_10.42.42.5(pid=5945): stderr: | 20221209011819277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011819277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011819277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011819278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011819278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011819278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011819278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:20.794956 run osmo-stp_10.42.42.5(pid=5945): stdout: | (launched: 2022-12-09_01:18:19.081647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:20.925081 run osmo-stp_10.42.42.5(pid=5945): stderr: | 20221209011819277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011819277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011819277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011819278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011819278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011819278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011819278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:21.080724 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5945): Process ended prematurely: osmo-stp_10.42.42.5(pid=5945) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5945)] [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:18:21.090573 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:18:21.118616 run osmo-hlr_10.42.42.2(pid=5942): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5942)] 01:18:21.169082 run osmo-hlr_10.42.42.2(pid=5942): stdout: | (launched: 2022-12-09_01:18:18.054437) 01:18:21.221257 run osmo-hlr_10.42.42.2(pid=5942): stderr: | 20221209011818254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011818254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011818254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011818254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011818254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011818254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011818267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011818275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011818275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011818275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:21.293787 run osmo-msc_10.42.42.6(pid=5948): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5948)] 01:18:21.344139 run osmo-msc_10.42.42.6(pid=5948): stdout: | (launched: 2022-12-09_01:18:20.136200) 01:18:21.395947 run osmo-msc_10.42.42.6(pid=5948): stderr: | 20221209011820463 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011820464 DLGLOBAL DEBUG validating counter group 0x7f479b153c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011820464 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011820464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011820464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011820464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011820466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011820466 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011820466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011820466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:21.447879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5941): Terminating (SIGTERM) 01:18:21.489651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5944): Terminating (SIGTERM) 01:18:21.531670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5947): Terminating (SIGTERM) 01:18:21.573762 --- ParallelTerminationStrategy: PID 5941 died... 01:18:21.593481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5941): Terminated: ok {rc=0} 01:18:21.639708 --- ParallelTerminationStrategy: PID 5944 died... 01:18:21.659471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5944): Terminated: ok {rc=0} 01:18:21.705749 --- ParallelTerminationStrategy: PID 5947 died... 01:18:21.725387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5947): Terminated: ok {rc=0} 01:18:21.814909 bus /sierra_3: Setting Powered False 01:18:22.916020 bus /sierra_3: Setting Powered False 01:18:24.034270 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:18:25.185051 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:25.197317 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:18:25.268235 tst mo_mt_call_osmux.py: using LAC 18066 01:18:25.398670 tst mo_mt_call_osmux.py: using RAC 216 01:18:25.528718 tst mo_mt_call_osmux.py: using CellId 18066 01:18:25.657403 tst mo_mt_call_osmux.py: using BVCI 18067 01:18:25.776049 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:25.787568 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:25.798913 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:25.810326 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:25.821879 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:25.833324 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:18:25.953266 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:18:26.069396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:26.547634 run create_hlr_db(pid=5950): Launched 01:18:26.667064 bus /sierra_2: Setting Powered False 01:18:27.727861 run create_hlr_db(pid=5950): Terminated: ok {rc=0} 01:18:28.177538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5952): Launched 01:18:28.510630 run osmo-hlr_10.42.42.2(pid=5953): Launched 01:18:28.637886 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:29.207507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5955): Launched 01:18:29.538132 run osmo-stp_10.42.42.5(pid=5956): Launched 01:18:29.664348 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:30.259216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5958): Launched 01:18:30.590247 run osmo-msc_10.42.42.6(pid=5959): Launched 01:18:30.773386 run osmo-stp_10.42.42.5(pid=5956): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5956)] 01:18:31.016350 run osmo-stp_10.42.42.5(pid=5956): stdout: | (launched: 2022-12-09_01:18:29.478519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:31.237962 run osmo-stp_10.42.42.5(pid=5956): stderr: | 20221209011829672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011829672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011829672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011829673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011829675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011829675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011829675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:31.390372 run osmo-stp_10.42.42.5(pid=5956): stdout: | (launched: 2022-12-09_01:18:29.478519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:31.522975 run osmo-stp_10.42.42.5(pid=5956): stderr: | 20221209011829672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011829672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011829672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011829673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011829675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011829675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011829675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:31.681851 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5956): Process ended prematurely: osmo-stp_10.42.42.5(pid=5956) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5956)] [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:18:31.692417 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:18:31.721707 run osmo-hlr_10.42.42.2(pid=5953): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5953)] 01:18:31.773021 run osmo-hlr_10.42.42.2(pid=5953): stdout: | (launched: 2022-12-09_01:18:28.450448) 01:18:31.826163 run osmo-hlr_10.42.42.2(pid=5953): stderr: | 20221209011828649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011828649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011828649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011828649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011828649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011828649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011828663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011828673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011828674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011828674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:31.899701 run osmo-msc_10.42.42.6(pid=5959): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5959)] 01:18:31.950678 run osmo-msc_10.42.42.6(pid=5959): stdout: | (launched: 2022-12-09_01:18:30.530455) 01:18:32.003304 run osmo-msc_10.42.42.6(pid=5959): stderr: | 20221209011830878 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011830879 DLGLOBAL DEBUG validating counter group 0x7f69d8d2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011830879 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011830879 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011830879 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011830879 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011830881 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011830881 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011830882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011830882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:32.056168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5952): Terminating (SIGTERM) 01:18:32.098834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5955): Terminating (SIGTERM) 01:18:32.141548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5958): Terminating (SIGTERM) 01:18:32.184376 --- ParallelTerminationStrategy: PID 5952 died... 01:18:32.204996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5952): Terminated: ok {rc=0} 01:18:32.252007 --- ParallelTerminationStrategy: PID 5955 died... 01:18:32.272726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5955): Terminated: ok {rc=0} 01:18:32.319820 --- ParallelTerminationStrategy: PID 5958 died... 01:18:32.340003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5958): Terminated: ok {rc=0} 01:18:32.429228 bus /sierra_3: Setting Powered False 01:18:33.528900 bus /sierra_3: Setting Powered False 01:18:34.645863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:18:35.904105 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:18:35.912126 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:18:35.945072 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:18:35.971146 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:18:36.024112 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:18:36.056456 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:18:36.082562 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:18:36.632593 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:18:36.687059 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:36.699031 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:18:36.769474 tst mo_mt_call.py: using LAC 18067 01:18:36.900515 tst mo_mt_call.py: using RAC 217 01:18:37.031336 tst mo_mt_call.py: using CellId 18067 01:18:37.160545 tst mo_mt_call.py: using BVCI 18068 01:18:37.280124 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:37.291823 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:37.303366 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:37.314825 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:37.326510 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:37.337938 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:37.454187 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:37.575029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:38.084824 run create_hlr_db(pid=5964): Launched 01:18:38.218664 bus /sierra_2: Setting Powered False 01:18:39.284216 run create_hlr_db(pid=5964): Terminated: ok {rc=0} 01:18:39.741657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5966): Launched 01:18:40.071976 run osmo-hlr_10.42.42.2(pid=5967): Launched 01:18:40.198008 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:40.765785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5969): Launched 01:18:41.095585 run osmo-stp_10.42.42.5(pid=5970): Launched 01:18:41.221104 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:41.815723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5972): Launched 01:18:42.144720 run osmo-msc_10.42.42.6(pid=5973): Launched 01:18:42.328624 run osmo-stp_10.42.42.5(pid=5970): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5970)] 01:18:42.467005 run osmo-stp_10.42.42.5(pid=5970): stdout: | (launched: 2022-12-09_01:18:41.035686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:42.606106 run osmo-stp_10.42.42.5(pid=5970): stderr: | 20221209011841230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011841230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011841230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011841230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011841231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011841231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011841231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:42.743633 run osmo-stp_10.42.42.5(pid=5970): stdout: | (launched: 2022-12-09_01:18:41.035686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:42.874170 run osmo-stp_10.42.42.5(pid=5970): stderr: | 20221209011841230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011841230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011841230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011841230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011841231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011841231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011841231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:43.030576 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5970): Process ended prematurely: osmo-stp_10.42.42.5(pid=5970) [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5970)] [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:18:43.040240 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:18:43.068287 run osmo-hlr_10.42.42.2(pid=5967): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5967)] 01:18:43.118843 run osmo-hlr_10.42.42.2(pid=5967): stdout: | (launched: 2022-12-09_01:18:40.011955) 01:18:43.170894 run osmo-hlr_10.42.42.2(pid=5967): stderr: | 20221209011840211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011840211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011840211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011840211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011840211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011840211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011840224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011840232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011840232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011840232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:43.243575 run osmo-msc_10.42.42.6(pid=5973): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5973)] 01:18:43.294066 run osmo-msc_10.42.42.6(pid=5973): stdout: | (launched: 2022-12-09_01:18:42.084732) 01:18:43.346009 run osmo-msc_10.42.42.6(pid=5973): stderr: | 20221209011842406 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011842406 DLGLOBAL DEBUG validating counter group 0x7f4f68ebac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011842406 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011842406 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011842407 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011842407 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011842408 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011842409 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011842409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011842409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:43.398229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5966): Terminating (SIGTERM) 01:18:43.440054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5969): Terminating (SIGTERM) 01:18:43.482045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5972): Terminating (SIGTERM) 01:18:43.524345 --- ParallelTerminationStrategy: PID 5966 died... 01:18:43.544648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5966): Terminated: ok {rc=0} 01:18:43.591350 --- ParallelTerminationStrategy: PID 5969 died... 01:18:43.611178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5969): Terminated: ok {rc=0} 01:18:43.657441 --- ParallelTerminationStrategy: PID 5972 died... 01:18:43.677218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5972): Terminated: ok {rc=0} 01:18:43.766032 bus /sierra_3: Setting Powered False 01:18:44.865676 bus /sierra_3: Setting Powered False 01:18:45.994030 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:18:47.147316 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:47.160180 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:18:47.232302 tst mo_mt_call_osmux.py: using LAC 18068 01:18:47.358810 tst mo_mt_call_osmux.py: using RAC 218 01:18:47.485729 tst mo_mt_call_osmux.py: using CellId 18068 01:18:47.606712 tst mo_mt_call_osmux.py: using BVCI 18069 01:18:47.721143 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:47.732428 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:47.743661 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:47.754823 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:47.766221 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:47.777889 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:47.896567 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:48.018667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:48.498355 run create_hlr_db(pid=5975): Launched 01:18:48.616318 bus /sierra_2: Setting Powered False 01:18:49.676579 run create_hlr_db(pid=5975): Terminated: ok {rc=0} 01:18:50.127644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5977): Launched 01:18:50.459234 run osmo-hlr_10.42.42.2(pid=5978): Launched 01:18:50.586593 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:51.154245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5980): Launched 01:18:51.485704 run osmo-stp_10.42.42.5(pid=5981): Launched 01:18:51.613784 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:52.211418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5983): Launched 01:18:52.541709 run osmo-msc_10.42.42.6(pid=5984): Launched 01:18:52.728180 run osmo-stp_10.42.42.5(pid=5981): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5981)] 01:18:52.866926 run osmo-stp_10.42.42.5(pid=5981): stdout: | (launched: 2022-12-09_01:18:51.425810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:53.006199 run osmo-stp_10.42.42.5(pid=5981): stderr: | 20221209011851618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011851619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011851619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011851619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011851622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011851623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011851623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:53.143756 run osmo-stp_10.42.42.5(pid=5981): stdout: | (launched: 2022-12-09_01:18:51.425810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:53.275431 run osmo-stp_10.42.42.5(pid=5981): stderr: | 20221209011851618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011851619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011851619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011851619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011851622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011851623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011851623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:53.432132 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5981): Process ended prematurely: osmo-stp_10.42.42.5(pid=5981) [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5981)] [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:18:53.441969 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:18:53.470045 run osmo-hlr_10.42.42.2(pid=5978): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5978)] 01:18:53.520635 run osmo-hlr_10.42.42.2(pid=5978): stdout: | (launched: 2022-12-09_01:18:50.398859) 01:18:53.572847 run osmo-hlr_10.42.42.2(pid=5978): stderr: | 20221209011850596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011850596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011850596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011850596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011850596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011850597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011850608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011850617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011850617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011850617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:53.645740 run osmo-msc_10.42.42.6(pid=5984): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5984)] 01:18:53.696310 run osmo-msc_10.42.42.6(pid=5984): stdout: | (launched: 2022-12-09_01:18:52.481751) 01:18:53.748932 run osmo-msc_10.42.42.6(pid=5984): stderr: | 20221209011852805 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011852805 DLGLOBAL DEBUG validating counter group 0x7f745bcf3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011852805 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011852805 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011852805 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011852805 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011852807 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011852807 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011852808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011852808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:53.801450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5977): Terminating (SIGTERM) 01:18:53.843583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5980): Terminating (SIGTERM) 01:18:53.885680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5983): Terminating (SIGTERM) 01:18:53.927814 --- ParallelTerminationStrategy: PID 5977 died... 01:18:53.948041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5977): Terminated: ok {rc=0} 01:18:53.994699 --- ParallelTerminationStrategy: PID 5980 died... 01:18:54.014517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5980): Terminated: ok {rc=0} 01:18:54.061218 --- ParallelTerminationStrategy: PID 5983 died... 01:18:54.080843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5983): Terminated: ok {rc=0} 01:18:54.169128 bus /sierra_3: Setting Powered False 01:18:55.268203 bus /sierra_3: Setting Powered False 01:18:56.383390 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:18:57.637579 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:18:57.643638 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:18:57.677210 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:18:57.704674 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:18:57.761731 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:18:57.795133 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:18:57.822275 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:18:58.369675 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:18:58.422299 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:58.433640 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:18:58.503378 tst mo_mt_call.py: using LAC 18069 01:18:58.630270 tst mo_mt_call.py: using RAC 219 01:18:58.757568 tst mo_mt_call.py: using CellId 18069 01:18:58.880560 tst mo_mt_call.py: using BVCI 18070 01:18:58.992745 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:59.003829 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:59.014717 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:59.026430 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:59.038127 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:59.049820 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:18:59.170256 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:18:59.286224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:59.763839 run create_hlr_db(pid=5991): Launched 01:18:59.881829 bus /sierra_2: Setting Powered False 01:19:00.942228 run create_hlr_db(pid=5991): Terminated: ok {rc=0} 01:19:01.408754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5993): Launched 01:19:01.750990 run osmo-hlr_10.42.42.2(pid=5994): Launched 01:19:01.999437 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:02.596511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5996): Launched 01:19:02.904783 run osmo-stp_10.42.42.5(pid=5997): Launched 01:19:03.022199 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:03.574559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5999): Launched 01:19:03.882442 run osmo-msc_10.42.42.6(pid=6000): Launched 01:19:04.054235 run osmo-stp_10.42.42.5(pid=5997): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5997)] 01:19:04.184383 run osmo-stp_10.42.42.5(pid=5997): stdout: | (launched: 2022-12-09_01:19:02.848706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:04.314454 run osmo-stp_10.42.42.5(pid=5997): stderr: | 20221209011903019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011903019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011903019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011903020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011903023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011903023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011903023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:04.442336 run osmo-stp_10.42.42.5(pid=5997): stdout: | (launched: 2022-12-09_01:19:02.848706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:04.564161 run osmo-stp_10.42.42.5(pid=5997): stderr: | 20221209011903019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011903019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011903019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011903020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011903023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011903023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011903023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:04.710194 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5997): Process ended prematurely: osmo-stp_10.42.42.5(pid=5997) [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5997)] [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:19:04.719360 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:19:04.746799 run osmo-hlr_10.42.42.2(pid=5994): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5994)] 01:19:04.794992 run osmo-hlr_10.42.42.2(pid=5994): stdout: | (launched: 2022-12-09_01:19:01.690352) 01:19:04.845131 run osmo-hlr_10.42.42.2(pid=5994): stderr: | 20221209011901913 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011901913 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011901913 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011901913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011901913 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011901914 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011901934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011901955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011901955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011901955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:04.914644 run osmo-msc_10.42.42.6(pid=6000): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6000)] 01:19:04.963200 run osmo-msc_10.42.42.6(pid=6000): stdout: | (launched: 2022-12-09_01:19:03.826193) 01:19:05.013458 run osmo-msc_10.42.42.6(pid=6000): stderr: | 20221209011904102 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011904103 DLGLOBAL DEBUG validating counter group 0x7fef7d703c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011904103 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011904103 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011904103 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011904103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011904105 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011904106 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011904106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011904106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:05.064422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5993): Terminating (SIGTERM) 01:19:05.104773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5996): Terminating (SIGTERM) 01:19:05.145115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5999): Terminating (SIGTERM) 01:19:05.186284 --- ParallelTerminationStrategy: PID 5993 died... 01:19:05.205382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5993): Terminated: ok {rc=0} 01:19:05.250058 --- ParallelTerminationStrategy: PID 5996 died... 01:19:05.268764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5996): Terminated: ok {rc=0} 01:19:05.313357 --- ParallelTerminationStrategy: PID 5999 died... 01:19:05.332008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5999): Terminated: ok {rc=0} 01:19:05.419381 bus /sierra_3: Setting Powered False 01:19:06.520147 bus /sierra_3: Setting Powered False 01:19:07.636221 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:19:08.783251 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:19:08.794801 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:19:08.865440 tst mo_mt_call_osmux.py: using LAC 18070 01:19:08.986553 tst mo_mt_call_osmux.py: using RAC 220 01:19:09.106875 tst mo_mt_call_osmux.py: using CellId 18070 01:19:09.237038 tst mo_mt_call_osmux.py: using BVCI 18071 01:19:09.350880 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:19:09.361869 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:19:09.372533 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:19:09.383490 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:19:09.394399 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:19:09.405414 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:19:09.528348 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:19:09.648740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:10.158769 run create_hlr_db(pid=6002): Launched 01:19:10.295558 bus /sierra_2: Setting Powered False 01:19:11.360695 run create_hlr_db(pid=6002): Terminated: ok {rc=0} 01:19:11.819042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6005): Launched 01:19:12.150111 run osmo-hlr_10.42.42.2(pid=6006): Launched 01:19:12.277106 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:12.849415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6008): Launched 01:19:13.182326 run osmo-stp_10.42.42.5(pid=6009): Launched 01:19:13.309592 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:13.911778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6011): Launched 01:19:14.242303 run osmo-msc_10.42.42.6(pid=6012): Launched 01:19:14.429661 run osmo-stp_10.42.42.5(pid=6009): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6009)] 01:19:14.568382 run osmo-stp_10.42.42.5(pid=6009): stdout: | (launched: 2022-12-09_01:19:13.122281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:14.707522 run osmo-stp_10.42.42.5(pid=6009): stderr: | 20221209011913316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011913316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011913316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011913317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011913317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011913317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011913317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:14.846185 run osmo-stp_10.42.42.5(pid=6009): stdout: | (launched: 2022-12-09_01:19:13.122281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:14.977605 run osmo-stp_10.42.42.5(pid=6009): stderr: | 20221209011913316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011913316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011913316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011913317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011913317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011913317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011913317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:15.134877 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6009): Process ended prematurely: osmo-stp_10.42.42.5(pid=6009) [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6009)] [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:19:15.144696 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 01:19:15.173036 run osmo-hlr_10.42.42.2(pid=6006): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6006)] 01:19:15.223463 run osmo-hlr_10.42.42.2(pid=6006): stdout: | (launched: 2022-12-09_01:19:12.090179) 01:19:15.275804 run osmo-hlr_10.42.42.2(pid=6006): stderr: | 20221209011912291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011912291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011912291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011912291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011912291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011912291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011912304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011912314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011912314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011912314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:15.348857 run osmo-msc_10.42.42.6(pid=6012): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6012)] 01:19:15.399064 run osmo-msc_10.42.42.6(pid=6012): stdout: | (launched: 2022-12-09_01:19:14.181870) 01:19:15.450832 run osmo-msc_10.42.42.6(pid=6012): stderr: | 20221209011914508 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011914508 DLGLOBAL DEBUG validating counter group 0x7fa5f6127c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011914508 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011914508 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011914508 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011914508 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011914510 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011914511 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011914511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011914511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:15.503071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6005): Terminating (SIGTERM) 01:19:15.545039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6008): Terminating (SIGTERM) 01:19:15.587110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6011): Terminating (SIGTERM) 01:19:15.629554 --- ParallelTerminationStrategy: PID 6005 died... 01:19:15.649874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6005): Terminated: ok {rc=0} 01:19:15.696615 --- ParallelTerminationStrategy: PID 6008 died... 01:19:15.716310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6008): Terminated: ok {rc=0} 01:19:15.762730 --- ParallelTerminationStrategy: PID 6011 died... 01:19:15.782662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6011): Terminated: ok {rc=0} 01:19:15.879073 bus /sierra_3: Setting Powered False 01:19:16.985457 bus /sierra_3: Setting Powered False 01:19:18.102360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:19:19.353568 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:19:19.360132 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:19:19.393162 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 01:19:19.420146 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 01:19:19.473734 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:19:19.506448 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 01:19:19.533475 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 01:19:20.086087 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 01:19:20.137816 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:20.149595 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:19:20.207991 tst mo_mt_call.py: using LAC 18071 01:19:20.335546 tst mo_mt_call.py: using RAC 221 01:19:20.461493 tst mo_mt_call.py: using CellId 18071 01:19:20.581979 tst mo_mt_call.py: using BVCI 18072 01:19:20.694739 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:20.706122 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:20.717344 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:20.729137 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:20.741382 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:20.753396 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:19:20.874293 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:19:20.993850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:21.496578 run create_hlr_db(pid=6018): Launched 01:19:21.629514 bus /sierra_2: Setting Powered False 01:19:22.692925 run create_hlr_db(pid=6018): Terminated: ok {rc=0} 01:19:23.126902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6020): Launched 01:19:23.431890 run osmo-hlr_10.42.42.2(pid=6021): Launched 01:19:23.548313 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:24.084854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6023): Launched 01:19:24.389951 run osmo-stp_10.42.42.5(pid=6024): Launched 01:19:24.506663 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:25.055168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6026): Launched 01:19:25.358678 run osmo-msc_10.42.42.6(pid=6027): Launched 01:19:25.528516 run osmo-stp_10.42.42.5(pid=6024): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6024)] 01:19:25.657358 run osmo-stp_10.42.42.5(pid=6024): stdout: | (launched: 2022-12-09_01:19:24.333922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:25.785758 run osmo-stp_10.42.42.5(pid=6024): stderr: | 20221209011924506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011924507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011924507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011924507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011924508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011924508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011924508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:25.911780 run osmo-stp_10.42.42.5(pid=6024): stdout: | (launched: 2022-12-09_01:19:24.333922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:26.032053 run osmo-stp_10.42.42.5(pid=6024): stderr: | 20221209011924506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011924507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011924507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011924507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011924508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011924508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011924508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:26.176652 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6024): Process ended prematurely: osmo-stp_10.42.42.5(pid=6024) [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6024)] [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 01:19:26.185558 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:19:26.212606 run osmo-hlr_10.42.42.2(pid=6021): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6021)] 01:19:26.260806 run osmo-hlr_10.42.42.2(pid=6021): stdout: | (launched: 2022-12-09_01:19:23.376234) 01:19:26.310909 run osmo-hlr_10.42.42.2(pid=6021): stderr: | 20221209011923551 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011923551 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011923551 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011923551 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011923551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011923551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011923565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011923575 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011923575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011923575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:26.380381 run osmo-msc_10.42.42.6(pid=6027): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6027)] 01:19:26.428489 run osmo-msc_10.42.42.6(pid=6027): stdout: | (launched: 2022-12-09_01:19:25.303201) 01:19:26.478342 run osmo-msc_10.42.42.6(pid=6027): stderr: | 20221209011925574 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011925575 DLGLOBAL DEBUG validating counter group 0x7fb2ed519c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011925575 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011925575 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011925575 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011925575 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011925577 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011925577 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011925577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011925578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:26.528647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6020): Terminating (SIGTERM) 01:19:26.568453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6023): Terminating (SIGTERM) 01:19:26.608365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6026): Terminating (SIGTERM) 01:19:26.648444 --- ParallelTerminationStrategy: PID 6020 died... 01:19:26.667518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6020): Terminated: ok {rc=0} 01:19:26.711904 --- ParallelTerminationStrategy: PID 6023 died... 01:19:26.730653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6023): Terminated: ok {rc=0} 01:19:26.774970 --- ParallelTerminationStrategy: PID 6026 died... 01:19:26.793568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6026): Terminated: ok {rc=0} 01:19:26.877327 bus /sierra_3: Setting Powered False 01:19:27.974263 bus /sierra_3: Setting Powered False 01:19:29.087854 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 01:19:30.237048 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:30.249620 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:19:30.302886 tst mo_mt_call_osmux.py: using LAC 18072 01:19:30.431879 tst mo_mt_call_osmux.py: using RAC 222 01:19:30.559859 tst mo_mt_call_osmux.py: using CellId 18072 01:19:30.687670 tst mo_mt_call_osmux.py: using BVCI 18073 01:19:30.807956 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:30.819776 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:30.831363 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:30.850679 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:30.863653 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:30.876042 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:19:31.006706 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:19:31.150638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:31.735575 run create_hlr_db(pid=6029): Launched 01:19:31.900409 bus /sierra_2: Setting Powered False 01:19:32.964892 run create_hlr_db(pid=6029): Terminated: ok {rc=0} 01:19:33.399451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6031): Launched 01:19:33.703398 run osmo-hlr_10.42.42.2(pid=6032): Launched 01:19:33.819535 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:34.341198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6034): Launched 01:19:34.645150 run osmo-stp_10.42.42.5(pid=6035): Launched 01:19:34.761209 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:35.310544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6037): Launched 01:19:35.614083 run osmo-msc_10.42.42.6(pid=6038): Launched 01:19:35.784578 run osmo-stp_10.42.42.5(pid=6035): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6035)] 01:19:35.913788 run osmo-stp_10.42.42.5(pid=6035): stdout: | (launched: 2022-12-09_01:19:34.589830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:36.042675 run osmo-stp_10.42.42.5(pid=6035): stderr: | 20221209011934759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011934759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011934760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011934760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011934761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011934761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011934761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:36.169330 run osmo-stp_10.42.42.5(pid=6035): stdout: | (launched: 2022-12-09_01:19:34.589830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:36.290180 run osmo-stp_10.42.42.5(pid=6035): stderr: | 20221209011934759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011934759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011934760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011934760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011934761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011934761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011934761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:36.434835 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6035): Process ended prematurely: osmo-stp_10.42.42.5(pid=6035) [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6035)] [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 01:19:36.443842 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:19:36.470695 run osmo-hlr_10.42.42.2(pid=6032): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6032)] 01:19:36.519205 run osmo-hlr_10.42.42.2(pid=6032): stdout: | (launched: 2022-12-09_01:19:33.647923) 01:19:36.569517 run osmo-hlr_10.42.42.2(pid=6032): stderr: | 20221209011933825 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011933825 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011933825 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011933825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011933825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011933825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011933840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011933850 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011933851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011933851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:36.638599 run osmo-msc_10.42.42.6(pid=6038): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6038)] 01:19:36.686270 run osmo-msc_10.42.42.6(pid=6038): stdout: | (launched: 2022-12-09_01:19:35.558652) 01:19:36.735659 run osmo-msc_10.42.42.6(pid=6038): stderr: | 20221209011935831 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011935831 DLGLOBAL DEBUG validating counter group 0x7f5a7ca96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011935831 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011935831 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011935831 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011935831 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011935833 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011935834 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011935834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011935834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:36.785503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6031): Terminating (SIGTERM) 01:19:36.825367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6034): Terminating (SIGTERM) 01:19:36.865032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6037): Terminating (SIGTERM) 01:19:36.905034 --- ParallelTerminationStrategy: PID 6031 died... 01:19:36.924131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6031): Terminated: ok {rc=0} 01:19:36.968409 --- ParallelTerminationStrategy: PID 6034 died... 01:19:36.987544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6034): Terminated: ok {rc=0} 01:19:37.032415 --- ParallelTerminationStrategy: PID 6037 died... 01:19:37.051109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6037): Terminated: ok {rc=0} 01:19:37.137839 bus /sierra_3: Setting Powered False 01:19:38.237785 bus /sierra_3: Setting Powered False 01:19:39.353353 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 emergency:trx-umtrx --------------------------------------------------------------------- 01:19:40.602922 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:19:40.607526 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:19:40.640140 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:19:40.666484 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 01:19:40.750338 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:19:40.782381 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:19:40.808682 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 01:19:41.390800 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2352 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 01:19:41.395677 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:41.406246 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 01:19:41.453953 tst emergency_mo_mt_call.py: using LAC 18073 01:19:41.572312 tst emergency_mo_mt_call.py: using RAC 223 01:19:41.689211 tst emergency_mo_mt_call.py: using CellId 18073 01:19:41.817728 tst emergency_mo_mt_call.py: using BVCI 18074 01:19:41.927808 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:41.938480 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:41.948812 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:41.959522 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:41.970190 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:41.980630 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:42.098200 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:42.220479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:42.717292 run create_hlr_db(pid=6043): Launched 01:19:42.848584 bus /sierra_2: Setting Powered False 01:19:43.912714 run create_hlr_db(pid=6043): Terminated: ok {rc=0} 01:19:44.341231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6045): Launched 01:19:44.641337 run osmo-hlr_10.42.42.2(pid=6047): Launched 01:19:44.756030 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:45.284917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6049): Launched 01:19:45.584703 run osmo-stp_10.42.42.5(pid=6050): Launched 01:19:45.709445 tst emergency_mo_mt_call.py: using MSISDN 6950 01:19:45.882181 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:46.483306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6052): Launched 01:19:46.792715 run osmo-msc_10.42.42.6(pid=6053): Launched 01:19:47.119567 run osmo-stp_10.42.42.5(pid=6050): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6050)] 01:19:47.261239 run osmo-stp_10.42.42.5(pid=6050): stdout: | (launched: 2022-12-09_01:19:45.529861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:47.412737 run osmo-stp_10.42.42.5(pid=6050): stderr: | 20221209011945699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011945699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011945700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011945700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011945701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011945701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011945701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:47.551574 run osmo-stp_10.42.42.5(pid=6050): stdout: | (launched: 2022-12-09_01:19:45.529861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:47.671199 run osmo-stp_10.42.42.5(pid=6050): stderr: | 20221209011945699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011945699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011945700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011945700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011945701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011945701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011945701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:47.814216 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6050): Process ended prematurely: osmo-stp_10.42.42.5(pid=6050) [trial-2352↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6050)] [trial-2352↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 01:19:47.822623 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 01:19:47.849105 run osmo-hlr_10.42.42.2(pid=6047): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6047)] 01:19:47.897909 run osmo-hlr_10.42.42.2(pid=6047): stdout: | (launched: 2022-12-09_01:19:44.586736) 01:19:47.948142 run osmo-hlr_10.42.42.2(pid=6047): stderr: | 20221209011944760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011944760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011944761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011944761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011944761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011944761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011944773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011944783 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011944783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011944783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:48.018324 run osmo-msc_10.42.42.6(pid=6053): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6053)] 01:19:48.066809 run osmo-msc_10.42.42.6(pid=6053): stdout: | (launched: 2022-12-09_01:19:46.734097) 01:19:48.117134 run osmo-msc_10.42.42.6(pid=6053): stderr: | 20221209011947292 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011947292 DLGLOBAL DEBUG validating counter group 0x7f6d6f70fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011947292 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011947292 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011947293 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011947293 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011947295 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011947295 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011947295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011947295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:48.167608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6045): Terminating (SIGTERM) 01:19:48.207758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6049): Terminating (SIGTERM) 01:19:48.248093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6052): Terminating (SIGTERM) 01:19:48.288457 --- ParallelTerminationStrategy: PID 6045 died... 01:19:48.307806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6045): Terminated: ok {rc=0} 01:19:48.352427 --- ParallelTerminationStrategy: PID 6049 died... 01:19:48.371106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6049): Terminated: ok {rc=0} 01:19:48.415955 --- ParallelTerminationStrategy: PID 6052 died... 01:19:48.434822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6052): Terminated: ok {rc=0} 01:19:48.519522 bus /sierra_3: Setting Powered False 01:19:49.618716 bus /sierra_3: Setting Powered False 01:19:50.737329 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 01:19:51.826829 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:51.838185 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 01:19:51.889509 tst emergency_preemptive_call.py: using LAC 18074 01:19:52.017342 tst emergency_preemptive_call.py: using RAC 224 01:19:52.142983 tst emergency_preemptive_call.py: using CellId 18074 01:19:52.269147 tst emergency_preemptive_call.py: using BVCI 18075 01:19:52.387424 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:52.398817 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:52.409947 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:52.421056 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:52.432053 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:52.443079 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:52.557639 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:52.677016 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:52.791207 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:52.905757 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:53.370139 run create_hlr_db(pid=6055): Launched 01:19:53.485317 bus /sierra_2: Setting Powered False 01:19:54.545290 run create_hlr_db(pid=6055): Terminated: ok {rc=0} 01:19:54.963804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6057): Launched 01:19:55.264494 run osmo-hlr_10.42.42.2(pid=6058): Launched 01:19:55.379313 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:55.907558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6060): Launched 01:19:56.207616 run osmo-stp_10.42.42.5(pid=6061): Launched 01:19:56.336148 tst emergency_preemptive_call.py: using MSISDN 6951 01:19:56.490072 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:57.024756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6063): Launched 01:19:57.324533 run osmo-msc_10.42.42.6(pid=6064): Launched 01:19:57.493707 run osmo-stp_10.42.42.5(pid=6061): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6061)] 01:19:57.620657 run osmo-stp_10.42.42.5(pid=6061): stdout: | (launched: 2022-12-09_01:19:56.152366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:57.748597 run osmo-stp_10.42.42.5(pid=6061): stderr: | 20221209011956321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011956321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011956321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011956322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011956322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011956322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011956322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:57.873324 run osmo-stp_10.42.42.5(pid=6061): stdout: | (launched: 2022-12-09_01:19:56.152366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:57.991976 run osmo-stp_10.42.42.5(pid=6061): stderr: | 20221209011956321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209011956321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209011956321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209011956322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209011956322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209011956322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209011956322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:58.134563 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6061): Process ended prematurely: osmo-stp_10.42.42.5(pid=6061) [trial-2352↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6061)] [trial-2352↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 01:19:58.142945 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 01:19:58.169586 run osmo-hlr_10.42.42.2(pid=6058): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6058)] 01:19:58.217999 run osmo-hlr_10.42.42.2(pid=6058): stdout: | (launched: 2022-12-09_01:19:55.209635) 01:19:58.267637 run osmo-hlr_10.42.42.2(pid=6058): stderr: | 20221209011955383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209011955383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209011955383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209011955383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209011955383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209011955383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209011955395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209011955404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209011955404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209011955404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:58.336913 run osmo-msc_10.42.42.6(pid=6064): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6064)] 01:19:58.384891 run osmo-msc_10.42.42.6(pid=6064): stdout: | (launched: 2022-12-09_01:19:57.269552) 01:19:58.434160 run osmo-msc_10.42.42.6(pid=6064): stderr: | 20221209011957541 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209011957541 DLGLOBAL DEBUG validating counter group 0x7fe6ff196c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209011957542 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209011957542 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209011957542 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209011957542 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209011957544 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209011957545 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209011957545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209011957545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:58.484064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6057): Terminating (SIGTERM) 01:19:58.524254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6060): Terminating (SIGTERM) 01:19:58.564301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6063): Terminating (SIGTERM) 01:19:58.604767 --- ParallelTerminationStrategy: PID 6057 died... 01:19:58.624003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6057): Terminated: ok {rc=0} 01:19:58.669335 --- ParallelTerminationStrategy: PID 6060 died... 01:19:58.687910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6060): Terminated: ok {rc=0} 01:19:58.732551 --- ParallelTerminationStrategy: PID 6063 died... 01:19:58.751399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6063): Terminated: ok {rc=0} 01:19:58.836503 bus /sierra_9: Setting Powered False 01:19:59.934499 bus /sierra_9: Setting Powered False 01:20:01.053168 bus /sierra_8: Setting Powered False 01:20:02.149638 bus /sierra_8: Setting Powered False 01:20:03.263176 bus /sierra_3: Setting Powered False 01:20:04.358188 bus /sierra_3: Setting Powered False 01:20:05.471167 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-umtrx --------------------------------------------------------------------- 01:20:06.753111 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:20:06.757605 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:20:06.790734 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 01:20:06.829887 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 01:20:06.918621 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:20:06.951599 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 01:20:06.990704 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 01:20:07.581995 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 01:20:07.634145 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:07.644786 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:20:07.695963 tst cs_paging_gprs_active.py: using LAC 18075 01:20:07.815621 tst cs_paging_gprs_active.py: using RAC 225 01:20:07.934376 tst cs_paging_gprs_active.py: using CellId 18075 01:20:08.054359 tst cs_paging_gprs_active.py: using BVCI 18076 01:20:08.166653 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:08.177297 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:08.187594 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:08.198430 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:08.209152 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:08.219762 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:08.230660 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:08.241580 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:08.252493 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:08.367875 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:08.482365 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:20:08.687407 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:08.993955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6072): Launched 01:20:09.261191 run iperf3-srv_10.42.42.10(pid=6073): Launched 01:20:09.375977 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:20:09.580047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:09.885482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6074): Launched 01:20:10.152370 run iperf3-srv_10.42.42.10(pid=6075): Launched 01:20:10.267547 tst cs_paging_gprs_active.py:38: start network... 01:20:10.471325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:10.942453 run create_hlr_db(pid=6076): Launched 01:20:11.059396 bus /sierra_2: Setting Powered False 01:20:12.119495 run create_hlr_db(pid=6076): Terminated: ok {rc=0} 01:20:12.566795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6078): Launched 01:20:12.893919 run osmo-hlr_10.42.42.2(pid=6079): Launched 01:20:13.019162 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:13.585396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6081): Launched 01:20:13.913412 run osmo-stp_10.42.42.5(pid=6082): Launched 01:20:14.039480 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:14.606370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6084): Launched 01:20:14.731557 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:15.006489 run patchelf(pid=6085): Launched 01:20:15.188541 run osmo-stp_10.42.42.5(pid=6082): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6082)] 01:20:15.327911 run osmo-stp_10.42.42.5(pid=6082): stdout: | (launched: 2022-12-09_01:20:13.853854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:15.468691 run osmo-stp_10.42.42.5(pid=6082): stderr: | 20221209012014043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012014043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012014044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012014044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012014044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012014045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012014045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:15.609732 run osmo-stp_10.42.42.5(pid=6082): stdout: | (launched: 2022-12-09_01:20:13.853854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:15.744081 run osmo-stp_10.42.42.5(pid=6082): stderr: | 20221209012014043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012014043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012014044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012014044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012014044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012014045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012014045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:15.911716 run patchelf(pid=6085): Terminating (SIGINT) 01:20:16.107494 run patchelf(pid=6085): Terminated: ok {rc=0} 01:20:16.238665 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6082): Process ended prematurely: osmo-stp_10.42.42.5(pid=6082) [trial-2352↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6082)] [trial-2352↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 01:20:16.249581 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:20:16.281111 run osmo-hlr_10.42.42.2(pid=6079): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6079)] 01:20:16.333306 run osmo-hlr_10.42.42.2(pid=6079): stdout: | (launched: 2022-12-09_01:20:12.834634) 01:20:16.386618 run osmo-hlr_10.42.42.2(pid=6079): stderr: | 20221209012013033 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012013033 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012013034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012013034 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012013034 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012013034 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012013046 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012013055 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012013055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012013055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:16.441624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6072): Terminating (SIGTERM) 01:20:16.484880 run iperf3-srv_10.42.42.10(pid=6073): Terminating (SIGTERM) 01:20:16.528829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6074): Terminating (SIGTERM) 01:20:16.572745 run iperf3-srv_10.42.42.10(pid=6075): Terminating (SIGTERM) 01:20:16.619001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6078): Terminating (SIGTERM) 01:20:16.662075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6081): Terminating (SIGTERM) 01:20:16.704894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6084): Terminating (SIGTERM) 01:20:16.748003 --- ParallelTerminationStrategy: PID 6072 died... 01:20:16.768300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6072): Terminated: ok {rc=0} 01:20:16.815720 --- ParallelTerminationStrategy: PID 6073 died... 01:20:16.835864 run iperf3-srv_10.42.42.10(pid=6073): Terminated {rc=256} 01:20:16.883037 --- ParallelTerminationStrategy: PID 6074 died... 01:20:16.903311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6074): Terminated: ok {rc=0} 01:20:16.950718 --- ParallelTerminationStrategy: PID 6075 died... 01:20:16.970875 run iperf3-srv_10.42.42.10(pid=6075): Terminated {rc=256} 01:20:17.018001 --- ParallelTerminationStrategy: PID 6078 died... 01:20:17.038219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6078): Terminated: ok {rc=0} 01:20:17.085477 --- ParallelTerminationStrategy: PID 6081 died... 01:20:17.105646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6081): Terminated: ok {rc=0} 01:20:17.152698 --- ParallelTerminationStrategy: PID 6084 died... 01:20:17.173058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6084): Terminated: ok {rc=0} 01:20:17.261793 bus /gobi_0: Setting Powered False 01:20:18.361124 bus /gobi_0: Setting Powered False 01:20:19.478384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx iperf3.py ---------------------------------------------- 01:20:20.625170 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:20.639821 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:20:20.692285 tst iperf3.py: using LAC 18076 01:20:20.813047 tst iperf3.py: using RAC 226 01:20:20.933061 tst iperf3.py: using CellId 18076 01:20:21.052791 tst iperf3.py: using BVCI 18077 01:20:21.164009 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.174797 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.185419 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.195885 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.206866 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.217566 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.228327 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.238966 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.249914 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:21.365037 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:20:21.587052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:21.914575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6086): Launched 01:20:22.199492 run iperf3-srv_10.42.42.10(pid=6087): Launched 01:20:22.322553 tst iperf3.py:8: start network... 01:20:22.543325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:23.048073 run create_hlr_db(pid=6088): Launched 01:20:23.181838 bus /gobi_6: Setting Powered False 01:20:24.246873 run create_hlr_db(pid=6088): Terminated: ok {rc=0} 01:20:24.682384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6090): Launched 01:20:24.987568 run osmo-hlr_10.42.42.2(pid=6091): Launched 01:20:25.104210 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:25.645236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6093): Launched 01:20:25.948610 run osmo-stp_10.42.42.5(pid=6095): Launched 01:20:26.064878 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:26.589362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6097): Launched 01:20:26.706602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:26.963219 run patchelf(pid=6098): Launched 01:20:27.133147 run osmo-stp_10.42.42.5(pid=6095): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6095)] 01:20:27.262502 run osmo-stp_10.42.42.5(pid=6095): stdout: | (launched: 2022-12-09_01:20:25.892930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:27.393271 run osmo-stp_10.42.42.5(pid=6095): stderr: | 20221209012026062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012026062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012026062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012026063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012026063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012026063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012026063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:27.524622 run osmo-stp_10.42.42.5(pid=6095): stdout: | (launched: 2022-12-09_01:20:25.892930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:27.649654 run osmo-stp_10.42.42.5(pid=6095): stderr: | 20221209012026062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012026062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012026062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012026063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012026063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012026063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012026063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:27.797654 run patchelf(pid=6098): Terminating (SIGINT) 01:20:27.968770 run patchelf(pid=6098): Terminated: ok {rc=0} 01:20:28.092276 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6095): Process ended prematurely: osmo-stp_10.42.42.5(pid=6095) [trial-2352↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6095)] [trial-2352↪gprs:trx-umtrx↪iperf3.py:8] 01:20:28.101792 tst iperf3.py:8: Test FAILED (7.5 sec) 01:20:28.130007 run osmo-hlr_10.42.42.2(pid=6091): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6091)] 01:20:28.177948 run osmo-hlr_10.42.42.2(pid=6091): stdout: | (launched: 2022-12-09_01:20:24.932035) 01:20:28.227588 run osmo-hlr_10.42.42.2(pid=6091): stderr: | 20221209012025108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012025109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012025109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012025109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012025109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012025109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012025121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012025130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012025130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012025130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:28.277788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6086): Terminating (SIGTERM) 01:20:28.317840 run iperf3-srv_10.42.42.10(pid=6087): Terminating (SIGTERM) 01:20:28.357895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6090): Terminating (SIGTERM) 01:20:28.398052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6093): Terminating (SIGTERM) 01:20:28.438005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6097): Terminating (SIGTERM) 01:20:28.478539 --- ParallelTerminationStrategy: PID 6086 died... 01:20:28.497788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6086): Terminated: ok {rc=0} 01:20:28.542699 --- ParallelTerminationStrategy: PID 6087 died... 01:20:28.561316 run iperf3-srv_10.42.42.10(pid=6087): Terminated {rc=256} 01:20:28.605756 --- ParallelTerminationStrategy: PID 6090 died... 01:20:28.624604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6090): Terminated: ok {rc=0} 01:20:28.669136 --- ParallelTerminationStrategy: PID 6093 died... 01:20:28.687859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6093): Terminated: ok {rc=0} 01:20:28.732302 --- ParallelTerminationStrategy: PID 6097 died... 01:20:28.750988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6097): Terminated: ok {rc=0} 01:20:28.837640 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 01:20:29.983893 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:29.995156 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:20:30.044178 tst iperf3m4.py: using LAC 18077 01:20:30.165123 tst iperf3m4.py: using RAC 227 01:20:30.284629 tst iperf3m4.py: using CellId 18077 01:20:30.403754 tst iperf3m4.py: using BVCI 18078 01:20:30.515687 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:30.526531 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:30.536782 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:30.547403 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:30.557980 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:30.568443 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:30.579184 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:30.589921 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:30.600746 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:30.715374 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:30.848067 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:30.980536 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:31.111596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:20:31.363405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:31.685973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6099): Launched 01:20:31.974675 run iperf3-srv_10.42.42.10(pid=6100): Launched 01:20:32.104094 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:20:32.313852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:32.618733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6101): Launched 01:20:32.883556 run iperf3-srv_10.42.42.10(pid=6102): Launched 01:20:32.997885 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:20:33.201303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:33.506980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6103): Launched 01:20:33.772440 run iperf3-srv_10.42.42.10(pid=6104): Launched 01:20:33.886961 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:20:34.091119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:34.396294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6105): Launched 01:20:34.661798 run iperf3-srv_10.42.42.10(pid=6106): Launched 01:20:34.776416 tst iperf3m4.py:8: start network... 01:20:34.980668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:35.452114 run create_hlr_db(pid=6107): Launched 01:20:35.569272 bus /gobi_6: Setting Powered False 01:20:36.629599 run create_hlr_db(pid=6107): Terminated: ok {rc=0} 01:20:37.074214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6109): Launched 01:20:37.402934 run osmo-hlr_10.42.42.2(pid=6110): Launched 01:20:37.529760 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:38.093708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6112): Launched 01:20:38.422542 run osmo-stp_10.42.42.5(pid=6113): Launched 01:20:38.546969 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:39.111306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6115): Launched 01:20:39.236219 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:39.513243 run patchelf(pid=6116): Launched 01:20:39.695613 run osmo-stp_10.42.42.5(pid=6113): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6113)] 01:20:39.834381 run osmo-stp_10.42.42.5(pid=6113): stdout: | (launched: 2022-12-09_01:20:38.362741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:39.974552 run osmo-stp_10.42.42.5(pid=6113): stderr: | 20221209012038553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012038553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012038553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012038554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012038554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012038554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012038554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:40.114963 run osmo-stp_10.42.42.5(pid=6113): stdout: | (launched: 2022-12-09_01:20:38.362741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:40.248838 run osmo-stp_10.42.42.5(pid=6113): stderr: | 20221209012038553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012038553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012038553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012038554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012038554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012038554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012038554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:40.407813 run patchelf(pid=6116): Terminating (SIGINT) 01:20:40.591107 run patchelf(pid=6116): Terminated: ok {rc=0} 01:20:40.723111 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6113): Process ended prematurely: osmo-stp_10.42.42.5(pid=6113) [trial-2352↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6113)] [trial-2352↪gprs:trx-umtrx↪iperf3m4.py:8] 01:20:40.733215 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:20:40.761964 run osmo-hlr_10.42.42.2(pid=6110): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6110)] 01:20:40.811682 run osmo-hlr_10.42.42.2(pid=6110): stdout: | (launched: 2022-12-09_01:20:37.343267) 01:20:40.863317 run osmo-hlr_10.42.42.2(pid=6110): stderr: | 20221209012037540 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012037540 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012037540 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012037540 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012037540 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012037540 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012037553 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012037562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012037562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012037562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:40.915047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6099): Terminating (SIGTERM) 01:20:40.956733 run iperf3-srv_10.42.42.10(pid=6100): Terminating (SIGTERM) 01:20:40.998658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6101): Terminating (SIGTERM) 01:20:41.040558 run iperf3-srv_10.42.42.10(pid=6102): Terminating (SIGTERM) 01:20:41.082244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6103): Terminating (SIGTERM) 01:20:41.124185 run iperf3-srv_10.42.42.10(pid=6104): Terminating (SIGTERM) 01:20:41.165629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6105): Terminating (SIGTERM) 01:20:41.207380 run iperf3-srv_10.42.42.10(pid=6106): Terminating (SIGTERM) 01:20:41.249121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6109): Terminating (SIGTERM) 01:20:41.291456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6112): Terminating (SIGTERM) 01:20:41.333515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6115): Terminating (SIGTERM) 01:20:41.375613 --- ParallelTerminationStrategy: PID 6099 died... 01:20:41.395729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6099): Terminated: ok {rc=0} 01:20:41.442262 --- ParallelTerminationStrategy: PID 6100 died... 01:20:41.461644 run iperf3-srv_10.42.42.10(pid=6100): Terminated {rc=256} 01:20:41.507769 --- ParallelTerminationStrategy: PID 6101 died... 01:20:41.527336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6101): Terminated: ok {rc=0} 01:20:41.573257 --- ParallelTerminationStrategy: PID 6102 died... 01:20:41.592499 run iperf3-srv_10.42.42.10(pid=6102): Terminated {rc=256} 01:20:41.638475 --- ParallelTerminationStrategy: PID 6103 died... 01:20:41.657869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6103): Terminated: ok {rc=0} 01:20:41.703512 --- ParallelTerminationStrategy: PID 6104 died... 01:20:41.722907 run iperf3-srv_10.42.42.10(pid=6104): Terminated {rc=256} 01:20:41.768624 --- ParallelTerminationStrategy: PID 6105 died... 01:20:41.788123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6105): Terminated: ok {rc=0} 01:20:41.833958 --- ParallelTerminationStrategy: PID 6106 died... 01:20:41.853250 run iperf3-srv_10.42.42.10(pid=6106): Terminated {rc=256} 01:20:41.898977 --- ParallelTerminationStrategy: PID 6109 died... 01:20:41.918461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6109): Terminated: ok {rc=0} 01:20:41.964049 --- ParallelTerminationStrategy: PID 6112 died... 01:20:41.983545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6112): Terminated: ok {rc=0} 01:20:42.029349 --- ParallelTerminationStrategy: PID 6115 died... 01:20:42.048848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6115): Terminated: ok {rc=0} 01:20:42.135959 bus /gobi_4: Setting Powered False 01:20:43.234894 bus /gobi_4: Setting Powered False 01:20:44.350089 bus /gobi_1: Setting Powered False 01:20:45.448512 bus /gobi_1: Setting Powered False 01:20:46.569428 bus /gobi_0: Setting Powered False 01:20:47.679667 bus /gobi_0: Setting Powered False 01:20:48.795293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx ping.py ---------------------------------------------- 01:20:49.898542 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:49.910310 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:20:49.960333 tst ping.py: using LAC 18078 01:20:50.087832 tst ping.py: using RAC 228 01:20:50.212735 tst ping.py: using CellId 18078 01:20:50.338276 tst ping.py: using BVCI 18079 01:20:50.456076 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:50.467097 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:50.478113 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:50.488910 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:50.499821 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:50.510865 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:50.521809 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:50.533273 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:50.647407 tst ping.py:19: start network... 01:20:50.849082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:51.309679 run create_hlr_db(pid=6117): Launched 01:20:51.424178 bus /gobi_6: Setting Powered False 01:20:52.484166 run create_hlr_db(pid=6117): Terminated: ok {rc=0} 01:20:52.922499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6119): Launched 01:20:53.243367 run osmo-hlr_10.42.42.2(pid=6120): Launched 01:20:53.366692 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:53.920746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6122): Launched 01:20:54.241313 run osmo-stp_10.42.42.5(pid=6123): Launched 01:20:54.365286 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:54.918923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6125): Launched 01:20:55.042048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:55.313067 run patchelf(pid=6126): Launched 01:20:55.491797 run osmo-stp_10.42.42.5(pid=6123): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6123)] 01:20:55.628337 run osmo-stp_10.42.42.5(pid=6123): stdout: | (launched: 2022-12-09_01:20:54.182683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:55.765885 run osmo-stp_10.42.42.5(pid=6123): stderr: | 20221209012054375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012054375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012054375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012054376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012054376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012054376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012054376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:55.903458 run osmo-stp_10.42.42.5(pid=6123): stdout: | (launched: 2022-12-09_01:20:54.182683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:56.034867 run osmo-stp_10.42.42.5(pid=6123): stderr: | 20221209012054375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012054375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012054375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012054376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012054376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012054376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012054376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:56.190571 run patchelf(pid=6126): Terminating (SIGINT) 01:20:56.370141 run patchelf(pid=6126): Terminated: ok {rc=0} 01:20:56.499641 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6123): Process ended prematurely: osmo-stp_10.42.42.5(pid=6123) [trial-2352↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6123)] [trial-2352↪gprs:trx-umtrx↪ping.py:22] 01:20:56.509099 tst ping.py:22: Test FAILED (6.6 sec) 01:20:56.537127 run osmo-hlr_10.42.42.2(pid=6120): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6120)] 01:20:56.586961 run osmo-hlr_10.42.42.2(pid=6120): stdout: | (launched: 2022-12-09_01:20:53.185100) 01:20:56.639052 run osmo-hlr_10.42.42.2(pid=6120): stderr: | 20221209012053382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012053382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012053382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012053382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012053382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012053382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012053395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012053403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012053403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012053403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:56.691035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6119): Terminating (SIGTERM) 01:20:56.732835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6122): Terminating (SIGTERM) 01:20:56.774932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6125): Terminating (SIGTERM) 01:20:56.816928 --- ParallelTerminationStrategy: PID 6119 died... 01:20:56.837093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6119): Terminated: ok {rc=0} 01:20:56.883301 --- ParallelTerminationStrategy: PID 6122 died... 01:20:56.903013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6122): Terminated: ok {rc=0} 01:20:56.948837 --- ParallelTerminationStrategy: PID 6125 died... 01:20:56.968820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6125): Terminated: ok {rc=0} 01:20:57.057448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 01:20:58.146297 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:58.158571 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:20:58.210430 tst ping_idle_ping.py: using LAC 18079 01:20:58.338684 tst ping_idle_ping.py: using RAC 229 01:20:58.466902 tst ping_idle_ping.py: using CellId 18079 01:20:58.594839 tst ping_idle_ping.py: using BVCI 18080 01:20:58.713403 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:58.724438 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:58.735381 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:58.746248 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:58.757023 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:58.767803 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:58.778875 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:58.789822 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:58.907609 tst ping_idle_ping.py:24: start network... 01:20:59.124273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:59.623316 run create_hlr_db(pid=6127): Launched 01:20:59.755029 bus /gobi_6: Setting Powered False 01:21:00.818732 run create_hlr_db(pid=6127): Terminated: ok {rc=0} 01:21:01.298676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6129): Launched 01:21:01.637320 run osmo-hlr_10.42.42.2(pid=6130): Launched 01:21:01.852863 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:02.519516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6132): Launched 01:21:02.841611 run osmo-stp_10.42.42.5(pid=6133): Launched 01:21:02.965450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:03.522942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6135): Launched 01:21:03.645967 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:03.916892 run patchelf(pid=6136): Launched 01:21:04.095557 run osmo-stp_10.42.42.5(pid=6133): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6133)] 01:21:04.231739 run osmo-stp_10.42.42.5(pid=6133): stdout: | (launched: 2022-12-09_01:21:02.782948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:04.369757 run osmo-stp_10.42.42.5(pid=6133): stderr: | 20221209012102974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012102974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012102974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012102975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012102975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012102975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012102975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:04.507832 run osmo-stp_10.42.42.5(pid=6133): stdout: | (launched: 2022-12-09_01:21:02.782948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:04.639285 run osmo-stp_10.42.42.5(pid=6133): stderr: | 20221209012102974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012102974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012102974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012102975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012102975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012102975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012102975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:04.795573 run patchelf(pid=6136): Terminating (SIGINT) 01:21:04.975105 run patchelf(pid=6136): Terminated: ok {rc=0} 01:21:05.104895 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6133): Process ended prematurely: osmo-stp_10.42.42.5(pid=6133) [trial-2352↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6133)] [trial-2352↪gprs:trx-umtrx↪ping_idle_ping.py:27] 01:21:05.114419 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 01:21:05.142663 run osmo-hlr_10.42.42.2(pid=6130): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6130)] 01:21:05.193118 run osmo-hlr_10.42.42.2(pid=6130): stdout: | (launched: 2022-12-09_01:21:01.577352) 01:21:05.245106 run osmo-hlr_10.42.42.2(pid=6130): stderr: | 20221209012101887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012101887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012101887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012101887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012101887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012101887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012101906 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012101914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012101914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012101914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:05.297454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6129): Terminating (SIGTERM) 01:21:05.339435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6132): Terminating (SIGTERM) 01:21:05.382042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6135): Terminating (SIGTERM) 01:21:05.424637 --- ParallelTerminationStrategy: PID 6129 died... 01:21:05.444842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6129): Terminated: ok {rc=0} 01:21:05.492147 --- ParallelTerminationStrategy: PID 6132 died... 01:21:05.512112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6132): Terminated: ok {rc=0} 01:21:05.558672 --- ParallelTerminationStrategy: PID 6135 died... 01:21:05.578544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6135): Terminated: ok {rc=0} 01:21:05.667785 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 01:21:06.974842 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:21:06.981057 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:21:07.015211 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:21:07.054570 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:21:07.143609 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:21:07.176800 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:21:07.216038 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:21:07.811099 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:21:07.863557 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:07.874823 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:21:07.925771 tst cs_paging_gprs_active.py: using LAC 18080 01:21:08.055390 tst cs_paging_gprs_active.py: using RAC 230 01:21:08.190272 tst cs_paging_gprs_active.py: using CellId 18080 01:21:08.318856 tst cs_paging_gprs_active.py: using BVCI 18081 01:21:08.439878 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:08.451284 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:08.462416 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:08.473538 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:08.484523 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:08.495668 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:08.506962 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:08.518019 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:08.529217 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:08.645477 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:08.762202 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:21:08.983422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:09.311767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6141): Launched 01:21:09.597713 run iperf3-srv_10.42.42.10(pid=6142): Launched 01:21:09.720853 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:21:09.942100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:10.271083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6143): Launched 01:21:10.557020 run iperf3-srv_10.42.42.10(pid=6144): Launched 01:21:10.679919 tst cs_paging_gprs_active.py:38: start network... 01:21:10.900935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:11.409600 run create_hlr_db(pid=6145): Launched 01:21:11.543984 bus /gobi_6: Setting Powered False 01:21:12.609279 run create_hlr_db(pid=6145): Terminated: ok {rc=0} 01:21:13.064160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6147): Launched 01:21:13.392174 run osmo-hlr_10.42.42.2(pid=6148): Launched 01:21:13.517901 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:14.083281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6150): Launched 01:21:14.410454 run osmo-stp_10.42.42.5(pid=6151): Launched 01:21:14.535524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:15.099322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6153): Launched 01:21:15.224488 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:15.501310 run patchelf(pid=6154): Launched 01:21:15.683434 run osmo-stp_10.42.42.5(pid=6151): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6151)] 01:21:15.822427 run osmo-stp_10.42.42.5(pid=6151): stdout: | (launched: 2022-12-09_01:21:14.350698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:15.970722 run osmo-stp_10.42.42.5(pid=6151): stderr: | 20221209012114542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012114542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012114542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012114543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012114543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012114543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012114543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:16.113284 run osmo-stp_10.42.42.5(pid=6151): stdout: | (launched: 2022-12-09_01:21:14.350698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:16.249242 run osmo-stp_10.42.42.5(pid=6151): stderr: | 20221209012114542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012114542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012114542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012114543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012114543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012114543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012114543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:16.412117 run patchelf(pid=6154): Terminating (SIGINT) 01:21:16.598827 run patchelf(pid=6154): Terminated: ok {rc=0} 01:21:16.733363 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6151): Process ended prematurely: osmo-stp_10.42.42.5(pid=6151) [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6151)] [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:21:16.744407 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 01:21:16.774586 run osmo-hlr_10.42.42.2(pid=6148): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6148)] 01:21:16.826222 run osmo-hlr_10.42.42.2(pid=6148): stdout: | (launched: 2022-12-09_01:21:13.331967) 01:21:16.879113 run osmo-hlr_10.42.42.2(pid=6148): stderr: | 20221209012113531 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012113531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012113531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012113531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012113531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012113531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012113544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012113552 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012113552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012113552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:16.932478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6141): Terminating (SIGTERM) 01:21:16.975677 run iperf3-srv_10.42.42.10(pid=6142): Terminating (SIGTERM) 01:21:17.020046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6143): Terminating (SIGTERM) 01:21:17.063160 run iperf3-srv_10.42.42.10(pid=6144): Terminating (SIGTERM) 01:21:17.105768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6147): Terminating (SIGTERM) 01:21:17.148539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6150): Terminating (SIGTERM) 01:21:17.191153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6153): Terminating (SIGTERM) 01:21:17.233388 --- ParallelTerminationStrategy: PID 6141 died... 01:21:17.253444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6141): Terminated: ok {rc=0} 01:21:17.299908 --- ParallelTerminationStrategy: PID 6142 died... 01:21:17.319447 run iperf3-srv_10.42.42.10(pid=6142): Terminated {rc=256} 01:21:17.365974 --- ParallelTerminationStrategy: PID 6143 died... 01:21:17.385607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6143): Terminated: ok {rc=0} 01:21:17.431781 --- ParallelTerminationStrategy: PID 6144 died... 01:21:17.451357 run iperf3-srv_10.42.42.10(pid=6144): Terminated {rc=256} 01:21:17.497639 --- ParallelTerminationStrategy: PID 6147 died... 01:21:17.517346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6147): Terminated: ok {rc=0} 01:21:17.563432 --- ParallelTerminationStrategy: PID 6150 died... 01:21:17.582899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6150): Terminated: ok {rc=0} 01:21:17.628660 --- ParallelTerminationStrategy: PID 6153 died... 01:21:17.648224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6153): Terminated: ok {rc=0} 01:21:17.735169 bus /gobi_0: Setting Powered False 01:21:18.834924 bus /gobi_0: Setting Powered False 01:21:19.956590 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:21:21.103290 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:21.114865 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:21:21.168072 tst iperf3.py: using LAC 18081 01:21:21.289627 tst iperf3.py: using RAC 231 01:21:21.419426 tst iperf3.py: using CellId 18081 01:21:21.547675 tst iperf3.py: using BVCI 18082 01:21:21.669022 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:21.680537 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:21.691740 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:21.702966 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:21.714169 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:21.725407 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:21.736722 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:21.747886 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:21.759058 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:21.875263 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:21:22.080846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:22.387265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6155): Launched 01:21:22.654156 run iperf3-srv_10.42.42.10(pid=6156): Launched 01:21:22.769114 tst iperf3.py:8: start network... 01:21:22.972597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:23.443329 run create_hlr_db(pid=6157): Launched 01:21:23.560431 bus /gobi_6: Setting Powered False 01:21:24.621617 run create_hlr_db(pid=6157): Terminated: ok {rc=0} 01:21:25.065914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6159): Launched 01:21:25.393690 run osmo-hlr_10.42.42.2(pid=6160): Launched 01:21:25.518780 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:26.091261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6162): Launched 01:21:26.418756 run osmo-stp_10.42.42.5(pid=6163): Launched 01:21:26.543705 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:27.106349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6165): Launched 01:21:27.231482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:27.507926 run patchelf(pid=6166): Launched 01:21:27.689736 run osmo-stp_10.42.42.5(pid=6163): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6163)] 01:21:27.827935 run osmo-stp_10.42.42.5(pid=6163): stdout: | (launched: 2022-12-09_01:21:26.359320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:27.968055 run osmo-stp_10.42.42.5(pid=6163): stderr: | 20221209012126551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012126551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012126551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012126552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012126552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012126552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012126552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:28.107817 run osmo-stp_10.42.42.5(pid=6163): stdout: | (launched: 2022-12-09_01:21:26.359320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:28.241617 run osmo-stp_10.42.42.5(pid=6163): stderr: | 20221209012126551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012126551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012126551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012126552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012126552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012126552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012126552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:28.400155 run patchelf(pid=6166): Terminating (SIGINT) 01:21:28.583615 run patchelf(pid=6166): Terminated: ok {rc=0} 01:21:28.715855 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6163): Process ended prematurely: osmo-stp_10.42.42.5(pid=6163) [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6163)] [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 01:21:28.726128 tst iperf3.py:8: Test FAILED (7.7 sec) 01:21:28.754911 run osmo-hlr_10.42.42.2(pid=6160): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6160)] 01:21:28.805097 run osmo-hlr_10.42.42.2(pid=6160): stdout: | (launched: 2022-12-09_01:21:25.333717) 01:21:28.856736 run osmo-hlr_10.42.42.2(pid=6160): stderr: | 20221209012125533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012125533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012125533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012125533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012125533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012125533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012125546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012125556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012125556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012125556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:28.908815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6155): Terminating (SIGTERM) 01:21:28.950324 run iperf3-srv_10.42.42.10(pid=6156): Terminating (SIGTERM) 01:21:28.991919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6159): Terminating (SIGTERM) 01:21:29.033751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6162): Terminating (SIGTERM) 01:21:29.075520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6165): Terminating (SIGTERM) 01:21:29.117745 --- ParallelTerminationStrategy: PID 6155 died... 01:21:29.137851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6155): Terminated: ok {rc=0} 01:21:29.184190 --- ParallelTerminationStrategy: PID 6156 died... 01:21:29.203914 run iperf3-srv_10.42.42.10(pid=6156): Terminated {rc=256} 01:21:29.250332 --- ParallelTerminationStrategy: PID 6159 died... 01:21:29.270092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6159): Terminated: ok {rc=0} 01:21:29.315930 --- ParallelTerminationStrategy: PID 6162 died... 01:21:29.335662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6162): Terminated: ok {rc=0} 01:21:29.381980 --- ParallelTerminationStrategy: PID 6165 died... 01:21:29.401703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6165): Terminated: ok {rc=0} 01:21:29.488623 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:21:30.639126 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:30.651070 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:21:30.701254 tst iperf3m4.py: using LAC 18082 01:21:30.828270 tst iperf3m4.py: using RAC 232 01:21:30.979130 tst iperf3m4.py: using CellId 18082 01:21:31.103528 tst iperf3m4.py: using BVCI 18083 01:21:31.243356 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:31.255384 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:31.267289 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:31.279162 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:31.291016 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:31.302872 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:31.314720 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:31.326283 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:31.338199 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:31.459297 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:31.581738 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:31.704502 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:31.852725 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:21:32.095564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:32.409405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6167): Launched 01:21:32.676401 run iperf3-srv_10.42.42.10(pid=6168): Launched 01:21:32.791797 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:21:32.996306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:33.303137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6169): Launched 01:21:33.568235 run iperf3-srv_10.42.42.10(pid=6170): Launched 01:21:33.682728 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:21:33.886918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:34.193676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6171): Launched 01:21:34.460381 run iperf3-srv_10.42.42.10(pid=6172): Launched 01:21:34.575241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:21:34.778712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:35.085128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6173): Launched 01:21:35.350665 run iperf3-srv_10.42.42.10(pid=6174): Launched 01:21:35.464750 tst iperf3m4.py:8: start network... 01:21:35.668871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:36.140015 run create_hlr_db(pid=6175): Launched 01:21:36.257897 bus /gobi_6: Setting Powered False 01:21:37.318311 run create_hlr_db(pid=6175): Terminated: ok {rc=0} 01:21:37.763775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6177): Launched 01:21:38.091218 run osmo-hlr_10.42.42.2(pid=6178): Launched 01:21:38.216075 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:38.780235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6180): Launched 01:21:39.106135 run osmo-stp_10.42.42.5(pid=6181): Launched 01:21:39.229996 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:39.791878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6183): Launched 01:21:39.917150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:40.193163 run patchelf(pid=6184): Launched 01:21:40.375498 run osmo-stp_10.42.42.5(pid=6181): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6181)] 01:21:40.514322 run osmo-stp_10.42.42.5(pid=6181): stdout: | (launched: 2022-12-09_01:21:39.046783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:40.654494 run osmo-stp_10.42.42.5(pid=6181): stderr: | 20221209012139237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012139237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012139237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012139238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012139238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012139238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012139238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:40.794917 run osmo-stp_10.42.42.5(pid=6181): stdout: | (launched: 2022-12-09_01:21:39.046783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:40.928717 run osmo-stp_10.42.42.5(pid=6181): stderr: | 20221209012139237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012139237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012139237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012139238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012139238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012139238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012139238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:41.087268 run patchelf(pid=6184): Terminating (SIGINT) 01:21:41.270873 run patchelf(pid=6184): Terminated: ok {rc=0} 01:21:41.403533 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6181): Process ended prematurely: osmo-stp_10.42.42.5(pid=6181) [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6181)] [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 01:21:41.413781 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:21:41.442664 run osmo-hlr_10.42.42.2(pid=6178): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6178)] 01:21:41.492534 run osmo-hlr_10.42.42.2(pid=6178): stdout: | (launched: 2022-12-09_01:21:38.031658) 01:21:41.544424 run osmo-hlr_10.42.42.2(pid=6178): stderr: | 20221209012138226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012138226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012138227 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012138227 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012138227 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012138227 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012138239 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012138249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012138249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012138249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:41.596709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6167): Terminating (SIGTERM) 01:21:41.638390 run iperf3-srv_10.42.42.10(pid=6168): Terminating (SIGTERM) 01:21:41.679941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6169): Terminating (SIGTERM) 01:21:41.721831 run iperf3-srv_10.42.42.10(pid=6170): Terminating (SIGTERM) 01:21:41.763294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6171): Terminating (SIGTERM) 01:21:41.804998 run iperf3-srv_10.42.42.10(pid=6172): Terminating (SIGTERM) 01:21:41.846617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6173): Terminating (SIGTERM) 01:21:41.888390 run iperf3-srv_10.42.42.10(pid=6174): Terminating (SIGTERM) 01:21:41.929977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6177): Terminating (SIGTERM) 01:21:41.971961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6180): Terminating (SIGTERM) 01:21:42.014013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6183): Terminating (SIGTERM) 01:21:42.055836 --- ParallelTerminationStrategy: PID 6167 died... 01:21:42.075892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6167): Terminated: ok {rc=0} 01:21:42.122275 --- ParallelTerminationStrategy: PID 6168 died... 01:21:42.142001 run iperf3-srv_10.42.42.10(pid=6168): Terminated {rc=256} 01:21:42.188253 --- ParallelTerminationStrategy: PID 6169 died... 01:21:42.208127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6169): Terminated: ok {rc=0} 01:21:42.254298 --- ParallelTerminationStrategy: PID 6170 died... 01:21:42.274038 run iperf3-srv_10.42.42.10(pid=6170): Terminated {rc=256} 01:21:42.320357 --- ParallelTerminationStrategy: PID 6171 died... 01:21:42.340051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6171): Terminated: ok {rc=0} 01:21:42.386819 --- ParallelTerminationStrategy: PID 6172 died... 01:21:42.406630 run iperf3-srv_10.42.42.10(pid=6172): Terminated {rc=256} 01:21:42.452916 --- ParallelTerminationStrategy: PID 6173 died... 01:21:42.472602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6173): Terminated: ok {rc=0} 01:21:42.518919 --- ParallelTerminationStrategy: PID 6174 died... 01:21:42.538824 run iperf3-srv_10.42.42.10(pid=6174): Terminated {rc=256} 01:21:42.585139 --- ParallelTerminationStrategy: PID 6177 died... 01:21:42.604912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6177): Terminated: ok {rc=0} 01:21:42.651256 --- ParallelTerminationStrategy: PID 6180 died... 01:21:42.671206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6180): Terminated: ok {rc=0} 01:21:42.717922 --- ParallelTerminationStrategy: PID 6183 died... 01:21:42.737638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6183): Terminated: ok {rc=0} 01:21:42.825922 bus /gobi_4: Setting Powered False 01:21:43.926532 bus /gobi_4: Setting Powered False 01:21:45.044636 bus /gobi_1: Setting Powered False 01:21:46.163483 bus /gobi_1: Setting Powered False 01:21:47.282684 bus /gobi_0: Setting Powered False 01:21:48.382023 bus /gobi_0: Setting Powered False 01:21:49.498067 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 01:21:50.601794 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:50.613748 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:21:50.665213 tst ping.py: using LAC 18083 01:21:50.792451 tst ping.py: using RAC 233 01:21:50.917775 tst ping.py: using CellId 18083 01:21:51.043637 tst ping.py: using BVCI 18084 01:21:51.159979 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:51.171226 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:51.182330 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:51.193424 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:51.204388 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:51.215389 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:51.226621 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:51.238068 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:51.354996 tst ping.py:19: start network... 01:21:51.572213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:52.069064 run create_hlr_db(pid=6185): Launched 01:21:52.200633 bus /gobi_6: Setting Powered False 01:21:53.264739 run create_hlr_db(pid=6185): Terminated: ok {rc=0} 01:21:53.696119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6187): Launched 01:21:53.996527 run osmo-hlr_10.42.42.2(pid=6188): Launched 01:21:54.111993 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:54.671106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6190): Launched 01:21:54.991111 run osmo-stp_10.42.42.5(pid=6191): Launched 01:21:55.113024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:55.666221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6193): Launched 01:21:55.788999 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:56.059755 run patchelf(pid=6194): Launched 01:21:56.238966 run osmo-stp_10.42.42.5(pid=6191): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6191)] 01:21:56.375392 run osmo-stp_10.42.42.5(pid=6191): stdout: | (launched: 2022-12-09_01:21:54.932628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:56.513594 run osmo-stp_10.42.42.5(pid=6191): stderr: | 20221209012155125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012155125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012155125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012155125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012155126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012155126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012155126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:56.651259 run osmo-stp_10.42.42.5(pid=6191): stdout: | (launched: 2022-12-09_01:21:54.932628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:56.782685 run osmo-stp_10.42.42.5(pid=6191): stderr: | 20221209012155125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012155125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012155125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012155125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012155126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012155126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012155126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:56.937962 run patchelf(pid=6194): Terminating (SIGINT) 01:21:57.117691 run patchelf(pid=6194): Terminated: ok {rc=0} 01:21:57.247011 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6191): Process ended prematurely: osmo-stp_10.42.42.5(pid=6191) [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6191)] [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 01:21:57.256318 tst ping.py:22: Test FAILED (6.6 sec) 01:21:57.284615 run osmo-hlr_10.42.42.2(pid=6188): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6188)] 01:21:57.334861 run osmo-hlr_10.42.42.2(pid=6188): stdout: | (launched: 2022-12-09_01:21:53.941101) 01:21:57.387311 run osmo-hlr_10.42.42.2(pid=6188): stderr: | 20221209012154119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012154119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012154119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012154119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012154119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012154119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012154131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012154140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012154140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012154141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:57.439887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6187): Terminating (SIGTERM) 01:21:57.482314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6190): Terminating (SIGTERM) 01:21:57.524780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6193): Terminating (SIGTERM) 01:21:57.567101 --- ParallelTerminationStrategy: PID 6187 died... 01:21:57.587255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6187): Terminated: ok {rc=0} 01:21:57.633976 --- ParallelTerminationStrategy: PID 6190 died... 01:21:57.653687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6190): Terminated: ok {rc=0} 01:21:57.700601 --- ParallelTerminationStrategy: PID 6193 died... 01:21:57.720486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6193): Terminated: ok {rc=0} 01:21:57.808568 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:21:58.896154 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:58.908150 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:21:58.960703 tst ping_idle_ping.py: using LAC 18084 01:21:59.088086 tst ping_idle_ping.py: using RAC 234 01:21:59.213405 tst ping_idle_ping.py: using CellId 18084 01:21:59.338460 tst ping_idle_ping.py: using BVCI 18085 01:21:59.455699 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:59.467229 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:59.478485 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:59.489821 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:59.500882 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:59.512222 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:59.523747 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:59.535077 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:59.653131 tst ping_idle_ping.py:24: start network... 01:21:59.871396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:00.372554 run create_hlr_db(pid=6195): Launched 01:22:00.504489 bus /gobi_6: Setting Powered False 01:22:01.571698 run create_hlr_db(pid=6195): Terminated: ok {rc=0} 01:22:02.007220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6197): Launched 01:22:02.324158 run osmo-hlr_10.42.42.2(pid=6198): Launched 01:22:02.487387 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:03.043815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6200): Launched 01:22:03.366826 run osmo-stp_10.42.42.5(pid=6201): Launched 01:22:03.490811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:04.045275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6203): Launched 01:22:04.168813 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:04.441314 run patchelf(pid=6204): Launched 01:22:04.620878 run osmo-stp_10.42.42.5(pid=6201): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6201)] 01:22:04.757609 run osmo-stp_10.42.42.5(pid=6201): stdout: | (launched: 2022-12-09_01:22:03.307941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:04.895829 run osmo-stp_10.42.42.5(pid=6201): stderr: | 20221209012203498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012203498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012203499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012203499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012203500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012203500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012203500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:05.034137 run osmo-stp_10.42.42.5(pid=6201): stdout: | (launched: 2022-12-09_01:22:03.307941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:05.165943 run osmo-stp_10.42.42.5(pid=6201): stderr: | 20221209012203498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012203498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012203499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012203499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012203500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012203500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012203500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:05.322260 run patchelf(pid=6204): Terminating (SIGINT) 01:22:05.503911 run patchelf(pid=6204): Terminated: ok {rc=0} 01:22:05.634333 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6201): Process ended prematurely: osmo-stp_10.42.42.5(pid=6201) [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6201)] [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 01:22:05.643840 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:22:05.672438 run osmo-hlr_10.42.42.2(pid=6198): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6198)] 01:22:05.722630 run osmo-hlr_10.42.42.2(pid=6198): stdout: | (launched: 2022-12-09_01:22:02.269152) 01:22:05.774633 run osmo-hlr_10.42.42.2(pid=6198): stderr: | 20221209012202486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012202486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012202486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012202486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012202487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012202487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012202503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012202513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012202513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012202513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:05.827252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6197): Terminating (SIGTERM) 01:22:05.869412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6200): Terminating (SIGTERM) 01:22:05.911763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6203): Terminating (SIGTERM) 01:22:05.954687 --- ParallelTerminationStrategy: PID 6197 died... 01:22:05.975158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6197): Terminated: ok {rc=0} 01:22:06.022361 --- ParallelTerminationStrategy: PID 6200 died... 01:22:06.042310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6200): Terminated: ok {rc=0} 01:22:06.089144 --- ParallelTerminationStrategy: PID 6203 died... 01:22:06.109143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6203): Terminated: ok {rc=0} 01:22:06.198778 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:22:07.502112 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:22:07.508189 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:22:07.541960 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:22:07.579782 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:22:07.665928 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:22:07.697983 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:22:07.735877 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:22:08.329478 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:22:08.379025 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:08.389972 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:22:08.458406 tst cs_paging_gprs_active.py: using LAC 18085 01:22:08.579771 tst cs_paging_gprs_active.py: using RAC 235 01:22:08.701464 tst cs_paging_gprs_active.py: using CellId 18085 01:22:08.823892 tst cs_paging_gprs_active.py: using BVCI 18086 01:22:08.936558 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:08.947421 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:08.958078 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:08.968891 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:08.979777 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:08.991083 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:09.002032 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:09.012753 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:09.023729 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:09.142332 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:09.263583 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:22:09.486359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:09.815898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6208): Launched 01:22:10.101728 run iperf3-srv_10.42.42.10(pid=6209): Launched 01:22:10.226288 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:22:10.448901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:10.778577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6210): Launched 01:22:11.064035 run iperf3-srv_10.42.42.10(pid=6211): Launched 01:22:11.186970 tst cs_paging_gprs_active.py:38: start network... 01:22:11.407532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:11.914732 run create_hlr_db(pid=6212): Launched 01:22:12.048425 bus /gobi_6: Setting Powered False 01:22:13.113535 run create_hlr_db(pid=6212): Terminated: ok {rc=0} 01:22:13.569186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6214): Launched 01:22:13.897427 run osmo-hlr_10.42.42.2(pid=6215): Launched 01:22:14.023462 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:14.587345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6217): Launched 01:22:14.913800 run osmo-stp_10.42.42.5(pid=6218): Launched 01:22:15.038338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:15.602468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6220): Launched 01:22:15.728065 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:16.045235 run patchelf(pid=6221): Launched 01:22:16.243901 run osmo-stp_10.42.42.5(pid=6218): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6218)] 01:22:16.386424 run osmo-stp_10.42.42.5(pid=6218): stdout: | (launched: 2022-12-09_01:22:14.854289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:16.529742 run osmo-stp_10.42.42.5(pid=6218): stderr: | 20221209012215045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012215045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012215045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012215046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012215046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012215046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012215046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:16.672831 run osmo-stp_10.42.42.5(pid=6218): stdout: | (launched: 2022-12-09_01:22:14.854289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:16.809398 run osmo-stp_10.42.42.5(pid=6218): stderr: | 20221209012215045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012215045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012215045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012215046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012215046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012215046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012215046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:16.971062 run patchelf(pid=6221): Terminating (SIGINT) 01:22:17.157325 run patchelf(pid=6221): Terminated: ok {rc=0} 01:22:17.290238 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6218): Process ended prematurely: osmo-stp_10.42.42.5(pid=6218) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6218)] [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:22:17.300356 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 01:22:17.329179 run osmo-hlr_10.42.42.2(pid=6215): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6215)] 01:22:17.379544 run osmo-hlr_10.42.42.2(pid=6215): stdout: | (launched: 2022-12-09_01:22:13.837779) 01:22:17.431484 run osmo-hlr_10.42.42.2(pid=6215): stderr: | 20221209012214036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012214036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012214036 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012214036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012214036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012214036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012214049 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012214057 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012214057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012214057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:17.483731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6208): Terminating (SIGTERM) 01:22:17.525622 run iperf3-srv_10.42.42.10(pid=6209): Terminating (SIGTERM) 01:22:17.567348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6210): Terminating (SIGTERM) 01:22:17.609214 run iperf3-srv_10.42.42.10(pid=6211): Terminating (SIGTERM) 01:22:17.650884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6214): Terminating (SIGTERM) 01:22:17.692707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6217): Terminating (SIGTERM) 01:22:17.734491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6220): Terminating (SIGTERM) 01:22:17.776592 --- ParallelTerminationStrategy: PID 6208 died... 01:22:17.796646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6208): Terminated: ok {rc=0} 01:22:17.842723 --- ParallelTerminationStrategy: PID 6209 died... 01:22:17.862237 run iperf3-srv_10.42.42.10(pid=6209): Terminated {rc=256} 01:22:17.908300 --- ParallelTerminationStrategy: PID 6210 died... 01:22:17.927990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6210): Terminated: ok {rc=0} 01:22:17.974033 --- ParallelTerminationStrategy: PID 6211 died... 01:22:17.993544 run iperf3-srv_10.42.42.10(pid=6211): Terminated {rc=256} 01:22:18.039545 --- ParallelTerminationStrategy: PID 6214 died... 01:22:18.059231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6214): Terminated: ok {rc=0} 01:22:18.105464 --- ParallelTerminationStrategy: PID 6217 died... 01:22:18.125097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6217): Terminated: ok {rc=0} 01:22:18.171262 --- ParallelTerminationStrategy: PID 6220 died... 01:22:18.190826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6220): Terminated: ok {rc=0} 01:22:18.278707 bus /gobi_0: Setting Powered False 01:22:19.376748 bus /gobi_0: Setting Powered False 01:22:20.492291 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:22:21.643474 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:21.655344 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:22:21.726555 tst iperf3.py: using LAC 18086 01:22:21.855887 tst iperf3.py: using RAC 236 01:22:21.988027 tst iperf3.py: using CellId 18086 01:22:22.116709 tst iperf3.py: using BVCI 18087 01:22:22.235336 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:22.246655 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:22.257790 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:22.268795 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:22.279822 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:22.291151 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:22.302437 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:22.313640 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:22.324864 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:22.441062 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:22:22.646282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:22.952714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6222): Launched 01:22:23.219458 run iperf3-srv_10.42.42.10(pid=6223): Launched 01:22:23.334511 tst iperf3.py:8: start network... 01:22:23.539259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:24.010889 run create_hlr_db(pid=6224): Launched 01:22:24.128644 bus /gobi_6: Setting Powered False 01:22:25.189416 run create_hlr_db(pid=6224): Terminated: ok {rc=0} 01:22:25.613975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6226): Launched 01:22:25.919949 run osmo-hlr_10.42.42.2(pid=6227): Launched 01:22:26.036165 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:26.667797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6229): Launched 01:22:26.965529 run osmo-stp_10.42.42.5(pid=6230): Launched 01:22:27.079936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:27.596925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6232): Launched 01:22:27.712215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:27.965620 run patchelf(pid=6233): Launched 01:22:28.133267 run osmo-stp_10.42.42.5(pid=6230): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6230)] 01:22:28.261087 run osmo-stp_10.42.42.5(pid=6230): stdout: | (launched: 2022-12-09_01:22:26.910911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:28.390668 run osmo-stp_10.42.42.5(pid=6230): stderr: | 20221209012227080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012227080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012227080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012227081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012227081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012227081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012227081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:28.519633 run osmo-stp_10.42.42.5(pid=6230): stdout: | (launched: 2022-12-09_01:22:26.910911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:28.642652 run osmo-stp_10.42.42.5(pid=6230): stderr: | 20221209012227080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012227080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012227080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012227081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012227081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012227081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012227081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:28.788459 run patchelf(pid=6233): Terminating (SIGINT) 01:22:28.957739 run patchelf(pid=6233): Terminated: ok {rc=0} 01:22:29.079791 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6230): Process ended prematurely: osmo-stp_10.42.42.5(pid=6230) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6230)] [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 01:22:29.089209 tst iperf3.py:8: Test FAILED (7.5 sec) 01:22:29.116710 run osmo-hlr_10.42.42.2(pid=6227): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6227)] 01:22:29.164674 run osmo-hlr_10.42.42.2(pid=6227): stdout: | (launched: 2022-12-09_01:22:25.864164) 01:22:29.214045 run osmo-hlr_10.42.42.2(pid=6227): stderr: | 20221209012226043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012226043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012226043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012226043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012226043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012226043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012226055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012226065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012226065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012226065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:29.263761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6222): Terminating (SIGTERM) 01:22:29.303575 run iperf3-srv_10.42.42.10(pid=6223): Terminating (SIGTERM) 01:22:29.343209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6226): Terminating (SIGTERM) 01:22:29.382991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6229): Terminating (SIGTERM) 01:22:29.422629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6232): Terminating (SIGTERM) 01:22:29.462655 --- ParallelTerminationStrategy: PID 6222 died... 01:22:29.481734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6222): Terminated: ok {rc=0} 01:22:29.526081 --- ParallelTerminationStrategy: PID 6223 died... 01:22:29.544751 run iperf3-srv_10.42.42.10(pid=6223): Terminated {rc=256} 01:22:29.589283 --- ParallelTerminationStrategy: PID 6226 died... 01:22:29.607918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6226): Terminated: ok {rc=0} 01:22:29.653020 --- ParallelTerminationStrategy: PID 6229 died... 01:22:29.671573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6229): Terminated: ok {rc=0} 01:22:29.715687 --- ParallelTerminationStrategy: PID 6232 died... 01:22:29.734283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6232): Terminated: ok {rc=0} 01:22:29.817495 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:22:30.982192 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:30.994655 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:22:31.071035 tst iperf3m4.py: using LAC 18087 01:22:31.239373 tst iperf3m4.py: using RAC 237 01:22:31.360160 tst iperf3m4.py: using CellId 18087 01:22:31.511358 tst iperf3m4.py: using BVCI 18088 01:22:31.658374 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:31.673101 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:31.689237 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:31.704705 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:31.716206 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:31.728558 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:31.740278 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:31.751969 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:31.763910 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:31.889512 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:32.017725 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:32.134840 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:32.251868 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:22:32.472656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:32.792749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6234): Launched 01:22:33.070448 run iperf3-srv_10.42.42.10(pid=6235): Launched 01:22:33.190438 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:22:33.406518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:33.727126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6236): Launched 01:22:34.005166 run iperf3-srv_10.42.42.10(pid=6237): Launched 01:22:34.124902 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:22:34.340312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:34.662076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6238): Launched 01:22:34.940026 run iperf3-srv_10.42.42.10(pid=6239): Launched 01:22:35.060107 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:22:35.275271 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:35.596326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6240): Launched 01:22:35.870824 run iperf3-srv_10.42.42.10(pid=6245): Launched 01:22:35.982571 tst iperf3m4.py:8: start network... 01:22:36.182932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:36.648586 run create_hlr_db(pid=6246): Launched 01:22:36.762849 bus /gobi_6: Setting Powered False 01:22:37.822458 run create_hlr_db(pid=6246): Terminated: ok {rc=0} 01:22:38.257707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6248): Launched 01:22:38.578454 run osmo-hlr_10.42.42.2(pid=6249): Launched 01:22:38.699607 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:39.246527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6251): Launched 01:22:39.565943 run osmo-stp_10.42.42.5(pid=6252): Launched 01:22:39.687169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:40.237947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6254): Launched 01:22:40.360472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:40.633456 run patchelf(pid=6255): Launched 01:22:40.811481 run osmo-stp_10.42.42.5(pid=6252): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6252)] 01:22:40.947387 run osmo-stp_10.42.42.5(pid=6252): stdout: | (launched: 2022-12-09_01:22:39.507917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:41.084578 run osmo-stp_10.42.42.5(pid=6252): stderr: | 20221209012239697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012239697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012239697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012239698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012239698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012239698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012239698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:41.221985 run osmo-stp_10.42.42.5(pid=6252): stdout: | (launched: 2022-12-09_01:22:39.507917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:41.353106 run osmo-stp_10.42.42.5(pid=6252): stderr: | 20221209012239697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012239697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012239697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012239698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012239698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012239698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012239698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:41.508825 run patchelf(pid=6255): Terminating (SIGINT) 01:22:41.688501 run patchelf(pid=6255): Terminated: ok {rc=0} 01:22:41.817878 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6252): Process ended prematurely: osmo-stp_10.42.42.5(pid=6252) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6252)] [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:22:41.827933 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:22:41.856644 run osmo-hlr_10.42.42.2(pid=6249): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6249)] 01:22:41.906787 run osmo-hlr_10.42.42.2(pid=6249): stdout: | (launched: 2022-12-09_01:22:38.520201) 01:22:41.959111 run osmo-hlr_10.42.42.2(pid=6249): stderr: | 20221209012238715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012238715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012238716 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012238716 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012238716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012238716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012238727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012238736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012238736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012238736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:42.011220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6234): Terminating (SIGTERM) 01:22:42.052912 run iperf3-srv_10.42.42.10(pid=6235): Terminating (SIGTERM) 01:22:42.094512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6236): Terminating (SIGTERM) 01:22:42.136363 run iperf3-srv_10.42.42.10(pid=6237): Terminating (SIGTERM) 01:22:42.177963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6238): Terminating (SIGTERM) 01:22:42.219613 run iperf3-srv_10.42.42.10(pid=6239): Terminating (SIGTERM) 01:22:42.261119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6240): Terminating (SIGTERM) 01:22:42.302747 run iperf3-srv_10.42.42.10(pid=6245): Terminating (SIGTERM) 01:22:42.344330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6248): Terminating (SIGTERM) 01:22:42.386029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6251): Terminating (SIGTERM) 01:22:42.428036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6254): Terminating (SIGTERM) 01:22:42.470473 --- ParallelTerminationStrategy: PID 6234 died... 01:22:42.490542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6234): Terminated: ok {rc=0} 01:22:42.536698 --- ParallelTerminationStrategy: PID 6235 died... 01:22:42.556199 run iperf3-srv_10.42.42.10(pid=6235): Terminated {rc=256} 01:22:42.602281 --- ParallelTerminationStrategy: PID 6236 died... 01:22:42.621791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6236): Terminated: ok {rc=0} 01:22:42.667768 --- ParallelTerminationStrategy: PID 6237 died... 01:22:42.687217 run iperf3-srv_10.42.42.10(pid=6237): Terminated {rc=256} 01:22:42.733119 --- ParallelTerminationStrategy: PID 6238 died... 01:22:42.752577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6238): Terminated: ok {rc=0} 01:22:42.798655 --- ParallelTerminationStrategy: PID 6239 died... 01:22:42.818187 run iperf3-srv_10.42.42.10(pid=6239): Terminated {rc=256} 01:22:42.864509 --- ParallelTerminationStrategy: PID 6240 died... 01:22:42.884101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6240): Terminated: ok {rc=0} 01:22:42.929966 --- ParallelTerminationStrategy: PID 6245 died... 01:22:42.949526 run iperf3-srv_10.42.42.10(pid=6245): Terminated {rc=256} 01:22:42.995439 --- ParallelTerminationStrategy: PID 6248 died... 01:22:43.014921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6248): Terminated: ok {rc=0} 01:22:43.060659 --- ParallelTerminationStrategy: PID 6251 died... 01:22:43.080109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6251): Terminated: ok {rc=0} 01:22:43.126070 --- ParallelTerminationStrategy: PID 6254 died... 01:22:43.145615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6254): Terminated: ok {rc=0} 01:22:43.233546 bus /gobi_4: Setting Powered False 01:22:44.333353 bus /gobi_4: Setting Powered False 01:22:45.451295 bus /gobi_1: Setting Powered False 01:22:46.555862 bus /gobi_1: Setting Powered False 01:22:47.685217 bus /gobi_0: Setting Powered False 01:22:48.783727 bus /gobi_0: Setting Powered False 01:22:49.899426 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:22:51.003131 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:51.014510 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:22:51.083827 tst ping.py: using LAC 18088 01:22:51.199532 tst ping.py: using RAC 238 01:22:51.317869 tst ping.py: using CellId 18088 01:22:51.435588 tst ping.py: using BVCI 18089 01:22:51.544846 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:51.555715 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:51.566431 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:51.577305 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:51.588017 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:51.598903 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:51.609805 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:51.620598 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:51.738007 tst ping.py:19: start network... 01:22:51.950483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:52.439509 run create_hlr_db(pid=6256): Launched 01:22:52.569197 bus /gobi_6: Setting Powered False 01:22:53.631824 run create_hlr_db(pid=6256): Terminated: ok {rc=0} 01:22:54.054485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6258): Launched 01:22:54.349713 run osmo-hlr_10.42.42.2(pid=6259): Launched 01:22:54.466382 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:54.989454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6261): Launched 01:22:55.286224 run osmo-stp_10.42.42.5(pid=6262): Launched 01:22:55.398879 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:55.909198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6264): Launched 01:22:56.022721 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:56.272250 run patchelf(pid=6265): Launched 01:22:56.436517 run osmo-stp_10.42.42.5(pid=6262): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6262)] 01:22:56.562210 run osmo-stp_10.42.42.5(pid=6262): stdout: | (launched: 2022-12-09_01:22:55.231766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:56.689407 run osmo-stp_10.42.42.5(pid=6262): stderr: | 20221209012255400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012255400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012255400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012255401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012255401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012255401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012255401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:56.816366 run osmo-stp_10.42.42.5(pid=6262): stdout: | (launched: 2022-12-09_01:22:55.231766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:56.937446 run osmo-stp_10.42.42.5(pid=6262): stderr: | 20221209012255400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012255400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012255400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012255401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012255401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012255401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012255401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:57.081482 run patchelf(pid=6265): Terminating (SIGINT) 01:22:57.247161 run patchelf(pid=6265): Terminated: ok {rc=0} 01:22:57.366986 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6262): Process ended prematurely: osmo-stp_10.42.42.5(pid=6262) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6262)] [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 01:22:57.376005 tst ping.py:22: Test FAILED (6.4 sec) 01:22:57.403206 run osmo-hlr_10.42.42.2(pid=6259): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6259)] 01:22:57.451160 run osmo-hlr_10.42.42.2(pid=6259): stdout: | (launched: 2022-12-09_01:22:54.295295) 01:22:57.501068 run osmo-hlr_10.42.42.2(pid=6259): stderr: | 20221209012254472 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012254472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012254472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012254472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012254472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012254472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012254485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012254494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012254494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012254494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:57.551078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6258): Terminating (SIGTERM) 01:22:57.591186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6261): Terminating (SIGTERM) 01:22:57.631159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6264): Terminating (SIGTERM) 01:22:57.671067 --- ParallelTerminationStrategy: PID 6258 died... 01:22:57.690295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6258): Terminated: ok {rc=0} 01:22:57.734786 --- ParallelTerminationStrategy: PID 6261 died... 01:22:57.753215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6261): Terminated: ok {rc=0} 01:22:57.797038 --- ParallelTerminationStrategy: PID 6264 died... 01:22:57.815376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6264): Terminated: ok {rc=0} 01:22:57.898203 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:22:58.981935 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:58.993415 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:22:59.064481 tst ping_idle_ping.py: using LAC 18089 01:22:59.181922 tst ping_idle_ping.py: using RAC 239 01:22:59.297309 tst ping_idle_ping.py: using CellId 18089 01:22:59.412507 tst ping_idle_ping.py: using BVCI 18090 01:22:59.519291 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:59.530158 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:59.540666 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:59.551463 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:59.562160 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:59.572894 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:59.583900 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:59.594795 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:59.709467 tst ping_idle_ping.py:24: start network... 01:22:59.907246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:00.364775 run create_hlr_db(pid=6266): Launched 01:23:00.477722 bus /gobi_6: Setting Powered False 01:23:01.580580 run create_hlr_db(pid=6266): Terminated: ok {rc=0} 01:23:02.143010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6317): Launched 01:23:02.573829 run osmo-hlr_10.42.42.2(pid=6342): Launched 01:23:02.886102 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:03.736154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6448): Launched 01:23:04.151559 run osmo-stp_10.42.42.5(pid=6503): Launched 01:23:04.415571 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:05.114579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6543): Launched 01:23:05.251085 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:05.531718 run patchelf(pid=6544): Launched 01:23:05.725767 run osmo-stp_10.42.42.5(pid=6503): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6503)] 01:23:05.864933 run osmo-stp_10.42.42.5(pid=6503): stdout: | (launched: 2022-12-09_01:23:04.079256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:06.003916 run osmo-stp_10.42.42.5(pid=6503): stderr: | 20221209012304435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012304435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012304435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012304436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012304436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012304436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012304436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:06.144206 run osmo-stp_10.42.42.5(pid=6503): stdout: | (launched: 2022-12-09_01:23:04.079256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:06.278851 run osmo-stp_10.42.42.5(pid=6503): stderr: | 20221209012304435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012304435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012304435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012304436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012304436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012304436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012304436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:06.438698 run patchelf(pid=6544): Terminating (SIGINT) 01:23:06.621822 run patchelf(pid=6544): Terminated: ok {rc=0} 01:23:06.755614 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6503): Process ended prematurely: osmo-stp_10.42.42.5(pid=6503) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6503)] [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:23:06.767344 tst ping_idle_ping.py:27: Test FAILED (7.8 sec) 01:23:06.796699 run osmo-hlr_10.42.42.2(pid=6342): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6342)] 01:23:06.848846 run osmo-hlr_10.42.42.2(pid=6342): stdout: | (launched: 2022-12-09_01:23:02.500426) 01:23:06.901474 run osmo-hlr_10.42.42.2(pid=6342): stderr: | 20221209012302877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012302877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012302877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012302877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012302878 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012302878 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012302899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012302918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012302919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012302919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:06.954356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6317): Terminating (SIGTERM) 01:23:06.998648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6448): Terminating (SIGTERM) 01:23:07.044536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6543): Terminating (SIGTERM) 01:23:07.089868 --- ParallelTerminationStrategy: PID 6317 died... 01:23:07.110637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6317): Terminated: ok {rc=0} 01:23:07.159063 --- ParallelTerminationStrategy: PID 6448 died... 01:23:07.179493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6448): Terminated: ok {rc=0} 01:23:07.226593 --- ParallelTerminationStrategy: PID 6543 died... 01:23:07.248008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6543): Terminated: ok {rc=0} 01:23:07.339308 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:23:08.650532 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:23:08.657675 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:23:08.692172 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:23:08.732780 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:23:08.820193 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:23:08.855123 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:23:08.894962 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:23:09.494719 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:23:09.549187 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:09.561694 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:23:09.634665 tst cs_paging_gprs_active.py: using LAC 18090 01:23:09.768773 tst cs_paging_gprs_active.py: using RAC 240 01:23:09.899487 tst cs_paging_gprs_active.py: using CellId 18090 01:23:10.026090 tst cs_paging_gprs_active.py: using BVCI 18091 01:23:10.148029 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:10.160392 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:10.172684 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:10.185265 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:10.197589 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:10.210433 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:10.223571 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:10.236777 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:10.250867 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:10.376782 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:10.505931 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:23:10.733775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:11.071416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6550): Launched 01:23:11.377172 run iperf3-srv_10.42.42.10(pid=6551): Launched 01:23:11.517399 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:23:11.745068 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:12.085324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6552): Launched 01:23:12.389645 run iperf3-srv_10.42.42.10(pid=6553): Launched 01:23:12.529182 tst cs_paging_gprs_active.py:38: start network... 01:23:12.755129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:13.271243 run create_hlr_db(pid=6554): Launched 01:23:13.442089 bus /gobi_6: Setting Powered False 01:23:14.507694 run create_hlr_db(pid=6554): Terminated: ok {rc=0} 01:23:14.976305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6556): Launched 01:23:15.324004 run osmo-hlr_10.42.42.2(pid=6557): Launched 01:23:15.576322 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:16.271676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6559): Launched 01:23:16.733880 run osmo-stp_10.42.42.5(pid=6560): Launched 01:23:16.989228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:17.773596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6562): Launched 01:23:17.939155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:18.279467 run patchelf(pid=6563): Launched 01:23:18.475000 run osmo-stp_10.42.42.5(pid=6560): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6560)] 01:23:18.615699 run osmo-stp_10.42.42.5(pid=6560): stdout: | (launched: 2022-12-09_01:23:16.659682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:18.762392 run osmo-stp_10.42.42.5(pid=6560): stderr: | 20221209012317007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012317007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012317007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012317008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012317008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012317008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012317008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:18.906578 run osmo-stp_10.42.42.5(pid=6560): stdout: | (launched: 2022-12-09_01:23:16.659682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:19.044319 run osmo-stp_10.42.42.5(pid=6560): stderr: | 20221209012317007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012317007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012317007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012317008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012317008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012317008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012317008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:19.205984 run patchelf(pid=6563): Terminating (SIGINT) 01:23:19.394609 run patchelf(pid=6563): Terminated: ok {rc=0} 01:23:19.532524 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6560): Process ended prematurely: osmo-stp_10.42.42.5(pid=6560) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6560)] [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:23:19.544184 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 01:23:19.574418 run osmo-hlr_10.42.42.2(pid=6557): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6557)] 01:23:19.627340 run osmo-hlr_10.42.42.2(pid=6557): stdout: | (launched: 2022-12-09_01:23:15.260371) 01:23:19.683535 run osmo-hlr_10.42.42.2(pid=6557): stderr: | 20221209012315562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012315562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012315562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012315562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012315562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012315562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012315585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012315601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012315601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012315601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:19.737607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6550): Terminating (SIGTERM) 01:23:19.781758 run iperf3-srv_10.42.42.10(pid=6551): Terminating (SIGTERM) 01:23:19.828456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6552): Terminating (SIGTERM) 01:23:19.873804 run iperf3-srv_10.42.42.10(pid=6553): Terminating (SIGTERM) 01:23:19.921211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6556): Terminating (SIGTERM) 01:23:19.966271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6559): Terminating (SIGTERM) 01:23:20.012708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6562): Terminating (SIGTERM) 01:23:20.059385 --- ParallelTerminationStrategy: PID 6550 died... 01:23:20.080230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6550): Terminated: ok {rc=0} 01:23:20.129405 --- ParallelTerminationStrategy: PID 6551 died... 01:23:20.149942 run iperf3-srv_10.42.42.10(pid=6551): Terminated {rc=256} 01:23:20.198151 --- ParallelTerminationStrategy: PID 6552 died... 01:23:20.219787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6552): Terminated: ok {rc=0} 01:23:20.268658 --- ParallelTerminationStrategy: PID 6553 died... 01:23:20.289528 run iperf3-srv_10.42.42.10(pid=6553): Terminated {rc=256} 01:23:20.337732 --- ParallelTerminationStrategy: PID 6556 died... 01:23:20.358726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6556): Terminated: ok {rc=0} 01:23:20.406505 --- ParallelTerminationStrategy: PID 6559 died... 01:23:20.428259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6559): Terminated: ok {rc=0} 01:23:20.477273 --- ParallelTerminationStrategy: PID 6562 died... 01:23:20.498253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6562): Terminated: ok {rc=0} 01:23:20.591838 bus /gobi_0: Setting Powered False 01:23:21.692010 bus /gobi_0: Setting Powered False 01:23:22.809923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:23:23.962202 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:23.974799 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:23:24.048857 tst iperf3.py: using LAC 18091 01:23:24.172526 tst iperf3.py: using RAC 241 01:23:24.296166 tst iperf3.py: using CellId 18091 01:23:24.423337 tst iperf3.py: using BVCI 18092 01:23:24.540185 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:24.552188 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:24.565488 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:24.577390 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:24.590493 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:24.603534 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:24.617349 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:24.630415 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:24.644013 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:24.763845 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:23:24.973269 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:25.285996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6564): Launched 01:23:25.570425 run iperf3-srv_10.42.42.10(pid=6565): Launched 01:23:25.704618 tst iperf3.py:8: start network... 01:23:25.911385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:26.378591 run create_hlr_db(pid=6567): Launched 01:23:26.496104 bus /gobi_6: Setting Powered False 01:23:27.555752 run create_hlr_db(pid=6567): Terminated: ok {rc=0} 01:23:27.974791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6569): Launched 01:23:28.276056 run osmo-hlr_10.42.42.2(pid=6570): Launched 01:23:28.392117 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:28.930933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6572): Launched 01:23:29.233580 run osmo-stp_10.42.42.5(pid=6573): Launched 01:23:29.350307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:29.873561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6575): Launched 01:23:29.997448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:30.270287 run patchelf(pid=6576): Launched 01:23:30.450921 run osmo-stp_10.42.42.5(pid=6573): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6573)] 01:23:30.588365 run osmo-stp_10.42.42.5(pid=6573): stdout: | (launched: 2022-12-09_01:23:29.178215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:30.726943 run osmo-stp_10.42.42.5(pid=6573): stderr: | 20221209012329350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012329350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012329350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012329351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012329351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012329351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012329351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:30.867173 run osmo-stp_10.42.42.5(pid=6573): stdout: | (launched: 2022-12-09_01:23:29.178215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:31.002045 run osmo-stp_10.42.42.5(pid=6573): stderr: | 20221209012329350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012329350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012329350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012329351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012329351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012329351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012329351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:31.161455 run patchelf(pid=6576): Terminating (SIGINT) 01:23:31.347357 run patchelf(pid=6576): Terminated: ok {rc=0} 01:23:31.482386 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6573): Process ended prematurely: osmo-stp_10.42.42.5(pid=6573) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6573)] [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 01:23:31.493627 tst iperf3.py:8: Test FAILED (7.6 sec) 01:23:31.523540 run osmo-hlr_10.42.42.2(pid=6570): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6570)] 01:23:31.575623 run osmo-hlr_10.42.42.2(pid=6570): stdout: | (launched: 2022-12-09_01:23:28.221089) 01:23:31.629186 run osmo-hlr_10.42.42.2(pid=6570): stderr: | 20221209012328395 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012328395 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012328395 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012328395 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012328395 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012328395 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012328407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012328416 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012328416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012328416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:31.682921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6564): Terminating (SIGTERM) 01:23:31.725751 run iperf3-srv_10.42.42.10(pid=6565): Terminating (SIGTERM) 01:23:31.768421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6569): Terminating (SIGTERM) 01:23:31.811657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6572): Terminating (SIGTERM) 01:23:31.855551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6575): Terminating (SIGTERM) 01:23:31.900263 --- ParallelTerminationStrategy: PID 6564 died... 01:23:31.920642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6564): Terminated: ok {rc=0} 01:23:31.967729 --- ParallelTerminationStrategy: PID 6565 died... 01:23:31.987742 run iperf3-srv_10.42.42.10(pid=6565): Terminated {rc=256} 01:23:32.035000 --- ParallelTerminationStrategy: PID 6569 died... 01:23:32.055483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6569): Terminated: ok {rc=0} 01:23:32.102876 --- ParallelTerminationStrategy: PID 6572 died... 01:23:32.122910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6572): Terminated: ok {rc=0} 01:23:32.170190 --- ParallelTerminationStrategy: PID 6575 died... 01:23:32.190385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6575): Terminated: ok {rc=0} 01:23:32.280375 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:23:33.435703 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:33.447831 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:23:33.522161 tst iperf3m4.py: using LAC 18092 01:23:33.648197 tst iperf3m4.py: using RAC 242 01:23:33.767106 tst iperf3m4.py: using CellId 18092 01:23:33.884798 tst iperf3m4.py: using BVCI 18093 01:23:33.994999 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:34.006220 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:34.017065 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:34.028609 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:34.039991 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:34.052363 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:34.063190 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:34.074463 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:34.086200 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:34.207561 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:34.326509 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:34.440857 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:34.560570 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:23:34.779479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:35.103603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6577): Launched 01:23:35.386480 run iperf3-srv_10.42.42.10(pid=6578): Launched 01:23:35.510323 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:23:35.728170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:36.054015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6579): Launched 01:23:36.317555 run iperf3-srv_10.42.42.10(pid=6582): Launched 01:23:36.432349 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:23:36.635876 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:36.947416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6583): Launched 01:23:37.229260 run iperf3-srv_10.42.42.10(pid=6584): Launched 01:23:37.352308 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:23:37.570923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:37.894770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6585): Launched 01:23:38.177213 run iperf3-srv_10.42.42.10(pid=6586): Launched 01:23:38.299394 tst iperf3m4.py:8: start network... 01:23:38.517353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:39.017240 run create_hlr_db(pid=6587): Launched 01:23:39.149642 bus /gobi_6: Setting Powered False 01:23:40.213049 run create_hlr_db(pid=6587): Terminated: ok {rc=0} 01:23:40.644031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6589): Launched 01:23:40.969447 run osmo-hlr_10.42.42.2(pid=6590): Launched 01:23:41.092456 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:41.651228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6592): Launched 01:23:41.974359 run osmo-stp_10.42.42.5(pid=6593): Launched 01:23:42.096730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:42.654283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6595): Launched 01:23:42.779940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:43.053990 run patchelf(pid=6596): Launched 01:23:43.233848 run osmo-stp_10.42.42.5(pid=6593): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6593)] 01:23:43.371216 run osmo-stp_10.42.42.5(pid=6593): stdout: | (launched: 2022-12-09_01:23:41.915251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:43.510525 run osmo-stp_10.42.42.5(pid=6593): stderr: | 20221209012342104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012342104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012342105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012342105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012342106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012342106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012342106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:43.649254 run osmo-stp_10.42.42.5(pid=6593): stdout: | (launched: 2022-12-09_01:23:41.915251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:43.781542 run osmo-stp_10.42.42.5(pid=6593): stderr: | 20221209012342104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012342104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012342105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012342105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012342106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012342106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012342106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:43.938222 run patchelf(pid=6596): Terminating (SIGINT) 01:23:44.119229 run patchelf(pid=6596): Terminated: ok {rc=0} 01:23:44.250150 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6593): Process ended prematurely: osmo-stp_10.42.42.5(pid=6593) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6593)] [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:23:44.260351 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:23:44.289268 run osmo-hlr_10.42.42.2(pid=6590): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6590)] 01:23:44.339540 run osmo-hlr_10.42.42.2(pid=6590): stdout: | (launched: 2022-12-09_01:23:40.909992) 01:23:44.391649 run osmo-hlr_10.42.42.2(pid=6590): stderr: | 20221209012341108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012341108 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012341108 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012341108 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012341108 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012341108 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012341120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012341129 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012341129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012341129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:44.444456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6577): Terminating (SIGTERM) 01:23:44.486668 run iperf3-srv_10.42.42.10(pid=6578): Terminating (SIGTERM) 01:23:44.528788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6579): Terminating (SIGTERM) 01:23:44.570781 run iperf3-srv_10.42.42.10(pid=6582): Terminating (SIGTERM) 01:23:44.612542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6583): Terminating (SIGTERM) 01:23:44.654500 run iperf3-srv_10.42.42.10(pid=6584): Terminating (SIGTERM) 01:23:44.696824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6585): Terminating (SIGTERM) 01:23:44.738780 run iperf3-srv_10.42.42.10(pid=6586): Terminating (SIGTERM) 01:23:44.780353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6589): Terminating (SIGTERM) 01:23:44.822305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6592): Terminating (SIGTERM) 01:23:44.864169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6595): Terminating (SIGTERM) 01:23:44.906474 --- ParallelTerminationStrategy: PID 6577 died... 01:23:44.926406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6577): Terminated: ok {rc=0} 01:23:44.973131 --- ParallelTerminationStrategy: PID 6578 died... 01:23:44.992553 run iperf3-srv_10.42.42.10(pid=6578): Terminated {rc=256} 01:23:45.038721 --- ParallelTerminationStrategy: PID 6579 died... 01:23:45.058193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6579): Terminated: ok {rc=0} 01:23:45.104101 --- ParallelTerminationStrategy: PID 6582 died... 01:23:45.123589 run iperf3-srv_10.42.42.10(pid=6582): Terminated {rc=256} 01:23:45.169347 --- ParallelTerminationStrategy: PID 6583 died... 01:23:45.188751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6583): Terminated: ok {rc=0} 01:23:45.234358 --- ParallelTerminationStrategy: PID 6584 died... 01:23:45.253774 run iperf3-srv_10.42.42.10(pid=6584): Terminated {rc=256} 01:23:45.299531 --- ParallelTerminationStrategy: PID 6585 died... 01:23:45.318966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6585): Terminated: ok {rc=0} 01:23:45.364819 --- ParallelTerminationStrategy: PID 6586 died... 01:23:45.384223 run iperf3-srv_10.42.42.10(pid=6586): Terminated {rc=256} 01:23:45.430539 --- ParallelTerminationStrategy: PID 6589 died... 01:23:45.449989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6589): Terminated: ok {rc=0} 01:23:45.495842 --- ParallelTerminationStrategy: PID 6592 died... 01:23:45.515239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6592): Terminated: ok {rc=0} 01:23:45.561123 --- ParallelTerminationStrategy: PID 6595 died... 01:23:45.580636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6595): Terminated: ok {rc=0} 01:23:45.668787 bus /gobi_4: Setting Powered False 01:23:46.768163 bus /gobi_4: Setting Powered False 01:23:47.886241 bus /gobi_1: Setting Powered False 01:23:48.985036 bus /gobi_1: Setting Powered False 01:23:50.101923 bus /gobi_0: Setting Powered False 01:23:51.201071 bus /gobi_0: Setting Powered False 01:23:52.317899 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:23:53.421372 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:53.433584 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:23:53.506408 tst ping.py: using LAC 18093 01:23:53.631097 tst ping.py: using RAC 243 01:23:53.757202 tst ping.py: using CellId 18093 01:23:53.881679 tst ping.py: using BVCI 18094 01:23:53.997271 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:54.008493 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:54.019744 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:54.030902 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:54.041932 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:54.053109 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:54.064306 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:54.075580 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:54.193551 tst ping.py:19: start network... 01:23:54.408188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:54.901374 run create_hlr_db(pid=6597): Launched 01:23:55.031344 bus /gobi_6: Setting Powered False 01:23:56.094901 run create_hlr_db(pid=6597): Terminated: ok {rc=0} 01:23:56.539030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6599): Launched 01:23:56.856400 run osmo-hlr_10.42.42.2(pid=6600): Launched 01:23:56.978148 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:57.525523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6602): Launched 01:23:57.846572 run osmo-stp_10.42.42.5(pid=6603): Launched 01:23:57.967268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:58.514729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6605): Launched 01:23:58.636286 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:58.904500 run patchelf(pid=6606): Launched 01:23:59.081655 run osmo-stp_10.42.42.5(pid=6603): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6603)] 01:23:59.217054 run osmo-stp_10.42.42.5(pid=6603): stdout: | (launched: 2022-12-09_01:23:57.787422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:59.353847 run osmo-stp_10.42.42.5(pid=6603): stderr: | 20221209012357979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012357979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012357979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012357980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012357980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012357980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012357980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:59.491412 run osmo-stp_10.42.42.5(pid=6603): stdout: | (launched: 2022-12-09_01:23:57.787422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:59.622491 run osmo-stp_10.42.42.5(pid=6603): stderr: | 20221209012357979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012357979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012357979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012357980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012357980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012357980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012357980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:59.777056 run patchelf(pid=6606): Terminating (SIGINT) 01:23:59.955389 run patchelf(pid=6606): Terminated: ok {rc=0} 01:24:00.083956 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6603): Process ended prematurely: osmo-stp_10.42.42.5(pid=6603) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6603)] [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 01:24:00.093720 tst ping.py:22: Test FAILED (6.7 sec) 01:24:00.121915 run osmo-hlr_10.42.42.2(pid=6600): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6600)] 01:24:00.172372 run osmo-hlr_10.42.42.2(pid=6600): stdout: | (launched: 2022-12-09_01:23:56.798653) 01:24:00.224424 run osmo-hlr_10.42.42.2(pid=6600): stderr: | 20221209012356995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012356995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012356995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012356995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012356995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012356995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012357027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012357037 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012357038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012357038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:00.276892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6599): Terminating (SIGTERM) 01:24:00.319051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6602): Terminating (SIGTERM) 01:24:00.361309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6605): Terminating (SIGTERM) 01:24:00.403698 --- ParallelTerminationStrategy: PID 6599 died... 01:24:00.424224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6599): Terminated: ok {rc=0} 01:24:00.471124 --- ParallelTerminationStrategy: PID 6602 died... 01:24:00.491111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6602): Terminated: ok {rc=0} 01:24:00.537594 --- ParallelTerminationStrategy: PID 6605 died... 01:24:00.557315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6605): Terminated: ok {rc=0} 01:24:00.647070 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:24:01.733538 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:24:01.746596 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:24:01.823815 tst ping_idle_ping.py: using LAC 18094 01:24:01.985231 tst ping_idle_ping.py: using RAC 244 01:24:02.113218 tst ping_idle_ping.py: using CellId 18094 01:24:02.253203 tst ping_idle_ping.py: using BVCI 18095 01:24:02.367136 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:24:02.378379 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:24:02.389431 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:24:02.401246 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:24:02.412651 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:24:02.424349 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:24:02.436431 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:24:02.450072 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:24:02.569524 tst ping_idle_ping.py:24: start network... 01:24:02.785869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:03.281891 run create_hlr_db(pid=6607): Launched 01:24:03.413622 bus /gobi_6: Setting Powered False 01:24:04.477827 run create_hlr_db(pid=6607): Terminated: ok {rc=0} 01:24:04.904836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6609): Launched 01:24:05.204576 run osmo-hlr_10.42.42.2(pid=6610): Launched 01:24:05.321676 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:05.836334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6612): Launched 01:24:06.136231 run osmo-stp_10.42.42.5(pid=6613): Launched 01:24:06.249728 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:06.764004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6615): Launched 01:24:06.878856 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:07.131093 run patchelf(pid=6616): Launched 01:24:07.297373 run osmo-stp_10.42.42.5(pid=6613): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6613)] 01:24:07.424045 run osmo-stp_10.42.42.5(pid=6613): stdout: | (launched: 2022-12-09_01:24:06.081633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:07.552625 run osmo-stp_10.42.42.5(pid=6613): stderr: | 20221209012406254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012406254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012406254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012406254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012406255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012406255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012406255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:07.681393 run osmo-stp_10.42.42.5(pid=6613): stdout: | (launched: 2022-12-09_01:24:06.081633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:07.803513 run osmo-stp_10.42.42.5(pid=6613): stderr: | 20221209012406254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012406254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012406254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012406254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012406255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012406255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012406255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:07.948389 run patchelf(pid=6616): Terminating (SIGINT) 01:24:08.116488 run patchelf(pid=6616): Terminated: ok {rc=0} 01:24:08.237684 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6613): Process ended prematurely: osmo-stp_10.42.42.5(pid=6613) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6613)] [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:24:08.246546 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:24:08.273927 run osmo-hlr_10.42.42.2(pid=6610): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6610)] 01:24:08.322711 run osmo-hlr_10.42.42.2(pid=6610): stdout: | (launched: 2022-12-09_01:24:05.150118) 01:24:08.372875 run osmo-hlr_10.42.42.2(pid=6610): stderr: | 20221209012405326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012405326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012405326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012405326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012405326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012405326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012405339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012405350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012405350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012405350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:08.423380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6609): Terminating (SIGTERM) 01:24:08.463617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6612): Terminating (SIGTERM) 01:24:08.503777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6615): Terminating (SIGTERM) 01:24:08.544346 --- ParallelTerminationStrategy: PID 6609 died... 01:24:08.563597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6609): Terminated: ok {rc=0} 01:24:08.608691 --- ParallelTerminationStrategy: PID 6612 died... 01:24:08.627939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6612): Terminated: ok {rc=0} 01:24:08.672557 --- ParallelTerminationStrategy: PID 6615 died... 01:24:08.691479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6615): Terminated: ok {rc=0} 01:24:08.775557 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:24:10.078859 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:24:10.087577 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:24:10.123990 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 01:24:10.162502 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 01:24:10.248434 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:24:10.280921 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 01:24:10.319654 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 01:24:10.932288 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 01:24:10.985963 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:10.998278 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:24:11.051843 tst cs_paging_gprs_active.py: using LAC 18095 01:24:11.181700 tst cs_paging_gprs_active.py: using RAC 245 01:24:11.302933 tst cs_paging_gprs_active.py: using CellId 18095 01:24:11.424140 tst cs_paging_gprs_active.py: using BVCI 18096 01:24:11.536361 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:11.547926 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:11.559090 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:11.571058 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:11.582682 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:11.594390 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:11.606521 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:11.618401 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:11.630328 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:11.752465 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:11.872173 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:24:12.095423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:12.419592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6620): Launched 01:24:12.703074 run iperf3-srv_10.42.42.10(pid=6621): Launched 01:24:12.826880 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:24:13.045707 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:13.372176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6622): Launched 01:24:13.655037 run iperf3-srv_10.42.42.10(pid=6623): Launched 01:24:13.778405 tst cs_paging_gprs_active.py:38: start network... 01:24:13.997443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:14.501574 run create_hlr_db(pid=6624): Launched 01:24:14.636238 bus /gobi_6: Setting Powered False 01:24:15.700631 run create_hlr_db(pid=6624): Terminated: ok {rc=0} 01:24:16.182130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6626): Launched 01:24:16.520367 run osmo-hlr_10.42.42.2(pid=6627): Launched 01:24:16.804613 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:17.477875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6629): Launched 01:24:17.782023 run osmo-stp_10.42.42.5(pid=6630): Launched 01:24:17.897856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:18.420229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6632): Launched 01:24:18.537094 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:18.793477 run patchelf(pid=6633): Launched 01:24:18.963214 run osmo-stp_10.42.42.5(pid=6630): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6630)] 01:24:19.091904 run osmo-stp_10.42.42.5(pid=6630): stdout: | (launched: 2022-12-09_01:24:17.726009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:19.223502 run osmo-stp_10.42.42.5(pid=6630): stderr: | 20221209012417898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012417898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012417898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012417898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012417899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012417899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012417899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:19.355221 run osmo-stp_10.42.42.5(pid=6630): stdout: | (launched: 2022-12-09_01:24:17.726009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:19.479931 run osmo-stp_10.42.42.5(pid=6630): stderr: | 20221209012417898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012417898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012417898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012417898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012417899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012417899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012417899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:19.627457 run patchelf(pid=6633): Terminating (SIGINT) 01:24:19.798589 run patchelf(pid=6633): Terminated: ok {rc=0} 01:24:19.921777 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6630): Process ended prematurely: osmo-stp_10.42.42.5(pid=6630) [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6630)] [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 01:24:19.931280 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 01:24:19.958718 run osmo-hlr_10.42.42.2(pid=6627): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6627)] 01:24:20.007324 run osmo-hlr_10.42.42.2(pid=6627): stdout: | (launched: 2022-12-09_01:24:16.460229) 01:24:20.057612 run osmo-hlr_10.42.42.2(pid=6627): stderr: | 20221209012416762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012416762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012416762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012416762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012416762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012416762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012416785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012416814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012416814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012416814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:20.108348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6620): Terminating (SIGTERM) 01:24:20.148399 run iperf3-srv_10.42.42.10(pid=6621): Terminating (SIGTERM) 01:24:20.188553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6622): Terminating (SIGTERM) 01:24:20.228749 run iperf3-srv_10.42.42.10(pid=6623): Terminating (SIGTERM) 01:24:20.268784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6626): Terminating (SIGTERM) 01:24:20.309193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6629): Terminating (SIGTERM) 01:24:20.349585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6632): Terminating (SIGTERM) 01:24:20.389814 --- ParallelTerminationStrategy: PID 6620 died... 01:24:20.409010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6620): Terminated: ok {rc=0} 01:24:20.453769 --- ParallelTerminationStrategy: PID 6621 died... 01:24:20.472291 run iperf3-srv_10.42.42.10(pid=6621): Terminated {rc=256} 01:24:20.516626 --- ParallelTerminationStrategy: PID 6622 died... 01:24:20.535411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6622): Terminated: ok {rc=0} 01:24:20.579555 --- ParallelTerminationStrategy: PID 6623 died... 01:24:20.598152 run iperf3-srv_10.42.42.10(pid=6623): Terminated {rc=256} 01:24:20.642681 --- ParallelTerminationStrategy: PID 6626 died... 01:24:20.661427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6626): Terminated: ok {rc=0} 01:24:20.705781 --- ParallelTerminationStrategy: PID 6629 died... 01:24:20.724292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6629): Terminated: ok {rc=0} 01:24:20.768816 --- ParallelTerminationStrategy: PID 6632 died... 01:24:20.787969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6632): Terminated: ok {rc=0} 01:24:20.871317 bus /gobi_0: Setting Powered False 01:24:21.971373 bus /gobi_0: Setting Powered False 01:24:23.091263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 01:24:24.237773 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:24.249631 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:24:24.304334 tst iperf3.py: using LAC 18096 01:24:24.423692 tst iperf3.py: using RAC 246 01:24:24.553352 tst iperf3.py: using CellId 18096 01:24:24.680498 tst iperf3.py: using BVCI 18097 01:24:24.801889 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:24.813789 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:24.825552 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:24.837892 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:24.850094 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:24.862618 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:24.874983 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:24.887664 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:24.899650 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:25.015385 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:24:25.218736 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:25.522973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6635): Launched 01:24:25.789064 run iperf3-srv_10.42.42.10(pid=6636): Launched 01:24:25.902636 tst iperf3.py:8: start network... 01:24:26.104939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:26.571118 run create_hlr_db(pid=6637): Launched 01:24:26.685635 bus /gobi_6: Setting Powered False 01:24:27.748566 run create_hlr_db(pid=6637): Terminated: ok {rc=0} 01:24:28.196576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6639): Launched 01:24:28.520043 run osmo-hlr_10.42.42.2(pid=6640): Launched 01:24:28.646758 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:29.206129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6642): Launched 01:24:29.529786 run osmo-stp_10.42.42.5(pid=6643): Launched 01:24:29.653657 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:30.212176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6645): Launched 01:24:30.335701 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:30.609954 run patchelf(pid=6646): Launched 01:24:30.789901 run osmo-stp_10.42.42.5(pid=6643): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6643)] 01:24:30.943381 run osmo-stp_10.42.42.5(pid=6643): stdout: | (launched: 2022-12-09_01:24:29.470811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:31.078713 run osmo-stp_10.42.42.5(pid=6643): stderr: | 20221209012429664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012429664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012429665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012429665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012429666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012429666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012429666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:31.213373 run osmo-stp_10.42.42.5(pid=6643): stdout: | (launched: 2022-12-09_01:24:29.470811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:31.343274 run osmo-stp_10.42.42.5(pid=6643): stderr: | 20221209012429664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012429664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012429665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012429665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012429666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012429666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012429666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:31.501999 run patchelf(pid=6646): Terminating (SIGINT) 01:24:31.687773 run patchelf(pid=6646): Terminated: ok {rc=0} 01:24:31.842941 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6643): Process ended prematurely: osmo-stp_10.42.42.5(pid=6643) [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6643)] [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 01:24:31.853932 tst iperf3.py:8: Test FAILED (7.7 sec) 01:24:31.883566 run osmo-hlr_10.42.42.2(pid=6640): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6640)] 01:24:31.934378 run osmo-hlr_10.42.42.2(pid=6640): stdout: | (launched: 2022-12-09_01:24:28.461483) 01:24:31.987258 run osmo-hlr_10.42.42.2(pid=6640): stderr: | 20221209012428659 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012428659 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012428659 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012428659 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012428659 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012428659 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012428672 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012428681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012428681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012428681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:32.040601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6635): Terminating (SIGTERM) 01:24:32.084173 run iperf3-srv_10.42.42.10(pid=6636): Terminating (SIGTERM) 01:24:32.129760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6639): Terminating (SIGTERM) 01:24:32.172519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6642): Terminating (SIGTERM) 01:24:32.215122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6645): Terminating (SIGTERM) 01:24:32.257815 --- ParallelTerminationStrategy: PID 6635 died... 01:24:32.277948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6635): Terminated: ok {rc=0} 01:24:32.324918 --- ParallelTerminationStrategy: PID 6636 died... 01:24:32.344634 run iperf3-srv_10.42.42.10(pid=6636): Terminated {rc=256} 01:24:32.390577 --- ParallelTerminationStrategy: PID 6639 died... 01:24:32.410199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6639): Terminated: ok {rc=0} 01:24:32.456629 --- ParallelTerminationStrategy: PID 6642 died... 01:24:32.476452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6642): Terminated: ok {rc=0} 01:24:32.522500 --- ParallelTerminationStrategy: PID 6645 died... 01:24:32.542201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6645): Terminated: ok {rc=0} 01:24:32.630219 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 01:24:33.781283 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:33.793900 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:24:33.848183 tst iperf3m4.py: using LAC 18097 01:24:33.976511 tst iperf3m4.py: using RAC 247 01:24:34.104718 tst iperf3m4.py: using CellId 18097 01:24:34.232656 tst iperf3m4.py: using BVCI 18098 01:24:34.349838 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.361689 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.373195 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.384676 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.396179 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.407640 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.419288 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.430660 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.442700 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:34.558098 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:34.677920 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:34.797421 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:34.916035 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:24:35.118984 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:35.421663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Launched 01:24:35.685432 run iperf3-srv_10.42.42.10(pid=6648): Launched 01:24:35.799691 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:24:36.002893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:36.307984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6649): Launched 01:24:36.592099 run iperf3-srv_10.42.42.10(pid=6650): Launched 01:24:36.714131 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:24:36.934344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:37.258966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6651): Launched 01:24:37.541672 run iperf3-srv_10.42.42.10(pid=6652): Launched 01:24:37.665066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:24:37.884108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:38.210104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6653): Launched 01:24:38.493224 run iperf3-srv_10.42.42.10(pid=6654): Launched 01:24:38.615762 tst iperf3m4.py:8: start network... 01:24:38.833830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:39.335350 run create_hlr_db(pid=6655): Launched 01:24:39.467761 bus /gobi_6: Setting Powered False 01:24:40.532671 run create_hlr_db(pid=6655): Terminated: ok {rc=0} 01:24:40.964641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6657): Launched 01:24:41.267524 run osmo-hlr_10.42.42.2(pid=6658): Launched 01:24:41.383445 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:41.907805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6660): Launched 01:24:42.211213 run osmo-stp_10.42.42.5(pid=6661): Launched 01:24:42.327187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:42.850279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6663): Launched 01:24:42.966678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:43.223654 run patchelf(pid=6664): Launched 01:24:43.392558 run osmo-stp_10.42.42.5(pid=6661): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6661)] 01:24:43.521679 run osmo-stp_10.42.42.5(pid=6661): stdout: | (launched: 2022-12-09_01:24:42.156033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:43.651255 run osmo-stp_10.42.42.5(pid=6661): stderr: | 20221209012442323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012442323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012442324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012442324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012442325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012442325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012442325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:43.781607 run osmo-stp_10.42.42.5(pid=6661): stdout: | (launched: 2022-12-09_01:24:42.156033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:43.905760 run osmo-stp_10.42.42.5(pid=6661): stderr: | 20221209012442323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012442323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012442324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012442324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012442325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012442325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012442325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:44.052560 run patchelf(pid=6664): Terminating (SIGINT) 01:24:44.223268 run patchelf(pid=6664): Terminated: ok {rc=0} 01:24:44.346610 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6661): Process ended prematurely: osmo-stp_10.42.42.5(pid=6661) [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6661)] [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 01:24:44.356077 tst iperf3m4.py:8: Test FAILED (10.6 sec) 01:24:44.384092 run osmo-hlr_10.42.42.2(pid=6658): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6658)] 01:24:44.432026 run osmo-hlr_10.42.42.2(pid=6658): stdout: | (launched: 2022-12-09_01:24:41.212472) 01:24:44.482361 run osmo-hlr_10.42.42.2(pid=6658): stderr: | 20221209012441385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012441385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012441385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012441385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012441385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012441385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012441410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012441419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012441419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012441419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:44.532915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Terminating (SIGTERM) 01:24:44.573266 run iperf3-srv_10.42.42.10(pid=6648): Terminating (SIGTERM) 01:24:44.613424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6649): Terminating (SIGTERM) 01:24:44.653259 run iperf3-srv_10.42.42.10(pid=6650): Terminating (SIGTERM) 01:24:44.693549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6651): Terminating (SIGTERM) 01:24:44.733593 run iperf3-srv_10.42.42.10(pid=6652): Terminating (SIGTERM) 01:24:44.773309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6653): Terminating (SIGTERM) 01:24:44.813667 run iperf3-srv_10.42.42.10(pid=6654): Terminating (SIGTERM) 01:24:44.853389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6657): Terminating (SIGTERM) 01:24:44.893418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6660): Terminating (SIGTERM) 01:24:44.933704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6663): Terminating (SIGTERM) 01:24:44.973902 --- ParallelTerminationStrategy: PID 6647 died... 01:24:44.992859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Terminated: ok {rc=0} 01:24:45.037416 --- ParallelTerminationStrategy: PID 6648 died... 01:24:45.055993 run iperf3-srv_10.42.42.10(pid=6648): Terminated {rc=256} 01:24:45.100276 --- ParallelTerminationStrategy: PID 6649 died... 01:24:45.118974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6649): Terminated: ok {rc=0} 01:24:45.162978 --- ParallelTerminationStrategy: PID 6650 died... 01:24:45.181572 run iperf3-srv_10.42.42.10(pid=6650): Terminated {rc=256} 01:24:45.225713 --- ParallelTerminationStrategy: PID 6651 died... 01:24:45.244384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6651): Terminated: ok {rc=0} 01:24:45.288752 --- ParallelTerminationStrategy: PID 6652 died... 01:24:45.307434 run iperf3-srv_10.42.42.10(pid=6652): Terminated {rc=256} 01:24:45.351622 --- ParallelTerminationStrategy: PID 6653 died... 01:24:45.370268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6653): Terminated: ok {rc=0} 01:24:45.414405 --- ParallelTerminationStrategy: PID 6654 died... 01:24:45.433267 run iperf3-srv_10.42.42.10(pid=6654): Terminated {rc=256} 01:24:45.477481 --- ParallelTerminationStrategy: PID 6657 died... 01:24:45.496065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6657): Terminated: ok {rc=0} 01:24:45.540273 --- ParallelTerminationStrategy: PID 6660 died... 01:24:45.559057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6660): Terminated: ok {rc=0} 01:24:45.603420 --- ParallelTerminationStrategy: PID 6663 died... 01:24:45.622207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6663): Terminated: ok {rc=0} 01:24:45.708267 bus /gobi_4: Setting Powered False 01:24:46.819205 bus /gobi_4: Setting Powered False 01:24:47.953145 bus /gobi_1: Setting Powered False 01:24:49.053419 bus /gobi_1: Setting Powered False 01:24:50.168494 bus /gobi_0: Setting Powered False 01:24:51.266672 bus /gobi_0: Setting Powered False 01:24:52.380340 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 01:24:53.484160 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:53.496681 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:24:53.551939 tst ping.py: using LAC 18098 01:24:53.679224 tst ping.py: using RAC 248 01:24:53.804064 tst ping.py: using CellId 18098 01:24:53.928343 tst ping.py: using BVCI 18099 01:24:54.043178 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:54.054982 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:54.066496 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:54.078173 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:54.089671 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:54.101197 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:54.112719 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:54.124798 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:54.240743 tst ping.py:19: start network... 01:24:54.439889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:54.898750 run create_hlr_db(pid=6665): Launched 01:24:55.012681 bus /gobi_6: Setting Powered False 01:24:56.072133 run create_hlr_db(pid=6665): Terminated: ok {rc=0} 01:24:56.507212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6667): Launched 01:24:56.824714 run osmo-hlr_10.42.42.2(pid=6668): Launched 01:24:56.946874 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:57.497469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6670): Launched 01:24:57.817653 run osmo-stp_10.42.42.5(pid=6671): Launched 01:24:57.940410 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:58.489070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6673): Launched 01:24:58.613060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:58.881518 run patchelf(pid=6674): Launched 01:24:59.060354 run osmo-stp_10.42.42.5(pid=6671): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6671)] 01:24:59.195854 run osmo-stp_10.42.42.5(pid=6671): stdout: | (launched: 2022-12-09_01:24:57.759920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:59.332770 run osmo-stp_10.42.42.5(pid=6671): stderr: | 20221209012457953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012457953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012457953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012457953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012457954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012457954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012457954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:59.470550 run osmo-stp_10.42.42.5(pid=6671): stdout: | (launched: 2022-12-09_01:24:57.759920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:59.601623 run osmo-stp_10.42.42.5(pid=6671): stderr: | 20221209012457953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012457953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012457953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012457953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012457954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012457954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012457954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:59.756916 run patchelf(pid=6674): Terminating (SIGINT) 01:24:59.935573 run patchelf(pid=6674): Terminated: ok {rc=0} 01:25:00.064636 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6671): Process ended prematurely: osmo-stp_10.42.42.5(pid=6671) [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6671)] [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 01:25:00.074433 tst ping.py:22: Test FAILED (6.6 sec) 01:25:00.102652 run osmo-hlr_10.42.42.2(pid=6668): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6668)] 01:25:00.152705 run osmo-hlr_10.42.42.2(pid=6668): stdout: | (launched: 2022-12-09_01:24:56.767067) 01:25:00.204739 run osmo-hlr_10.42.42.2(pid=6668): stderr: | 20221209012456967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012456967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012456968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012456968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012456968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012456968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012456981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012456991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012456991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012456991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:00.256841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6667): Terminating (SIGTERM) 01:25:00.298739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6670): Terminating (SIGTERM) 01:25:00.340609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6673): Terminating (SIGTERM) 01:25:00.382656 --- ParallelTerminationStrategy: PID 6667 died... 01:25:00.402723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6667): Terminated: ok {rc=0} 01:25:00.449231 --- ParallelTerminationStrategy: PID 6670 died... 01:25:00.469237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6670): Terminated: ok {rc=0} 01:25:00.515369 --- ParallelTerminationStrategy: PID 6673 died... 01:25:00.534984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6673): Terminated: ok {rc=0} 01:25:00.622870 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 01:25:01.709596 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:25:01.722901 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:25:01.779992 tst ping_idle_ping.py: using LAC 18099 01:25:01.920148 tst ping_idle_ping.py: using RAC 249 01:25:02.046822 tst ping_idle_ping.py: using CellId 18099 01:25:02.175784 tst ping_idle_ping.py: using BVCI 18100 01:25:02.293571 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:25:02.306147 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:25:02.318509 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:25:02.330442 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:25:02.342160 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:25:02.353992 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:25:02.365867 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:25:02.377573 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:25:02.496607 tst ping_idle_ping.py:24: start network... 01:25:02.711938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:03.205689 run create_hlr_db(pid=6678): Launched 01:25:03.336302 bus /gobi_6: Setting Powered False 01:25:04.400210 run create_hlr_db(pid=6678): Terminated: ok {rc=0} 01:25:04.845214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6680): Launched 01:25:05.163224 run osmo-hlr_10.42.42.2(pid=6681): Launched 01:25:05.286816 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:05.835608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6683): Launched 01:25:06.154468 run osmo-stp_10.42.42.5(pid=6684): Launched 01:25:06.278372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:25:06.829831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6686): Launched 01:25:06.953473 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:25:07.222434 run patchelf(pid=6687): Launched 01:25:07.401152 run osmo-stp_10.42.42.5(pid=6684): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6684)] 01:25:07.537612 run osmo-stp_10.42.42.5(pid=6684): stdout: | (launched: 2022-12-09_01:25:06.096264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:07.674938 run osmo-stp_10.42.42.5(pid=6684): stderr: | 20221209012506287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012506287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012506288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012506288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012506289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012506289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012506289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:07.811721 run osmo-stp_10.42.42.5(pid=6684): stdout: | (launched: 2022-12-09_01:25:06.096264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:07.942331 run osmo-stp_10.42.42.5(pid=6684): stderr: | 20221209012506287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012506287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012506288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012506288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012506289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012506289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012506289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:08.097501 run patchelf(pid=6687): Terminating (SIGINT) 01:25:08.275726 run patchelf(pid=6687): Terminated: ok {rc=0} 01:25:08.404368 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6684): Process ended prematurely: osmo-stp_10.42.42.5(pid=6684) [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6684)] [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 01:25:08.414020 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:25:08.442025 run osmo-hlr_10.42.42.2(pid=6681): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6681)] 01:25:08.492595 run osmo-hlr_10.42.42.2(pid=6681): stdout: | (launched: 2022-12-09_01:25:05.105096) 01:25:08.544725 run osmo-hlr_10.42.42.2(pid=6681): stderr: | 20221209012505302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012505302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012505302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012505302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012505302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012505302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012505314 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012505323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012505323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012505323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:08.597282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6680): Terminating (SIGTERM) 01:25:08.639119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6683): Terminating (SIGTERM) 01:25:08.681086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6686): Terminating (SIGTERM) 01:25:08.723351 --- ParallelTerminationStrategy: PID 6680 died... 01:25:08.743651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6680): Terminated: ok {rc=0} 01:25:08.791035 --- ParallelTerminationStrategy: PID 6683 died... 01:25:08.810923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6683): Terminated: ok {rc=0} 01:25:08.857456 --- ParallelTerminationStrategy: PID 6686 died... 01:25:08.877386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6686): Terminated: ok {rc=0} 01:25:08.965826 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:25:10.270272 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:10.276913 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:25:10.310161 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:25:10.344704 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:25:10.397765 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:25:10.430232 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:25:10.464748 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:25:11.031005 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:25:11.037565 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:25:11.049217 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:25:11.121354 tst switch_tch_pdch.py: using LAC 18100 01:25:11.239537 tst switch_tch_pdch.py: using RAC 250 01:25:11.357714 tst switch_tch_pdch.py: using CellId 18100 01:25:11.479449 tst switch_tch_pdch.py: using BVCI 18101 01:25:11.588602 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:25:11.599970 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:25:11.611121 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:25:11.622586 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:25:11.634082 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:25:11.645228 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:25:11.656536 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:25:11.667772 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:25:11.784657 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:25:11.901902 tst switch_tch_pdch.py:51: start network... 01:25:12.100733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:12.558074 run create_hlr_db(pid=6691): Launched 01:25:12.673974 bus /gobi_6: Setting Powered False 01:25:13.733537 run create_hlr_db(pid=6691): Terminated: ok {rc=0} 01:25:14.148782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6693): Launched 01:25:14.446091 run osmo-hlr_10.42.42.2(pid=6694): Launched 01:25:14.559361 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:15.071224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6696): Launched 01:25:15.367185 run osmo-stp_10.42.42.5(pid=6697): Launched 01:25:15.480722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:25:16.037888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6699): Launched 01:25:16.173595 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:25:16.451752 run patchelf(pid=6700): Launched 01:25:16.673092 run osmo-stp_10.42.42.5(pid=6697): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6697)] 01:25:16.817865 run osmo-stp_10.42.42.5(pid=6697): stdout: | (launched: 2022-12-09_01:25:15.313381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:16.960216 run osmo-stp_10.42.42.5(pid=6697): stderr: | 20221209012515482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012515482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012515482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012515483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012515485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012515485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012515485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:17.102006 run osmo-stp_10.42.42.5(pid=6697): stdout: | (launched: 2022-12-09_01:25:15.313381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:17.234943 run osmo-stp_10.42.42.5(pid=6697): stderr: | 20221209012515482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012515482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012515482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012515483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012515485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012515485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012515485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:17.390372 run patchelf(pid=6700): Terminating (SIGINT) 01:25:17.569268 run patchelf(pid=6700): Terminated: ok {rc=0} 01:25:17.699150 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6697): Process ended prematurely: osmo-stp_10.42.42.5(pid=6697) [trial-2352↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6697)] [trial-2352↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:25:17.709070 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 01:25:17.738074 run osmo-hlr_10.42.42.2(pid=6694): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6694)] 01:25:17.789276 run osmo-hlr_10.42.42.2(pid=6694): stdout: | (launched: 2022-12-09_01:25:14.391443) 01:25:17.842160 run osmo-hlr_10.42.42.2(pid=6694): stderr: | 20221209012514567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012514567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012514567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012514567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012514567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012514567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012514582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012514592 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012514592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012514592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:17.895542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6693): Terminating (SIGTERM) 01:25:17.938022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6696): Terminating (SIGTERM) 01:25:17.980263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6699): Terminating (SIGTERM) 01:25:18.022733 --- ParallelTerminationStrategy: PID 6693 died... 01:25:18.043042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6693): Terminated: ok {rc=0} 01:25:18.090262 --- ParallelTerminationStrategy: PID 6696 died... 01:25:18.110157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6696): Terminated: ok {rc=0} 01:25:18.156933 --- ParallelTerminationStrategy: PID 6699 died... 01:25:18.176871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6699): Terminated: ok {rc=0} 01:25:18.265564 bus /gobi_0: Setting Powered False 01:25:19.364536 bus /gobi_0: Setting Powered False 01:25:20.481515 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:25:21.737870 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:21.743649 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:25:21.776733 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:25:21.811467 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:25:21.862182 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:25:21.894892 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:25:21.929164 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:25:22.484458 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:25:22.489954 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:22.500818 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:25:22.568513 tst switch_tch_pdch.py: using LAC 18101 01:25:22.683461 tst switch_tch_pdch.py: using RAC 251 01:25:22.802478 tst switch_tch_pdch.py: using CellId 18101 01:25:22.919154 tst switch_tch_pdch.py: using BVCI 18102 01:25:23.026759 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:23.037847 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:23.048651 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:23.060226 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:23.071517 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:23.082841 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:23.094164 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:23.105495 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:25:23.222951 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:25:23.337425 tst switch_tch_pdch.py:51: start network... 01:25:23.537083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:23.968538 run create_hlr_db(pid=6704): Launched 01:25:24.081650 bus /gobi_6: Setting Powered False 01:25:25.145062 run create_hlr_db(pid=6704): Terminated: ok {rc=0} 01:25:25.546077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6706): Launched 01:25:25.842915 run osmo-hlr_10.42.42.2(pid=6707): Launched 01:25:25.956197 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:26.445687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6709): Launched 01:25:26.742235 run osmo-stp_10.42.42.5(pid=6710): Launched 01:25:26.857885 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:25:27.342892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6712): Launched 01:25:27.456524 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:25:27.706668 run patchelf(pid=6713): Launched 01:25:27.874265 run osmo-stp_10.42.42.5(pid=6710): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6710)] 01:25:28.000426 run osmo-stp_10.42.42.5(pid=6710): stdout: | (launched: 2022-12-09_01:25:26.688016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:28.128240 run osmo-stp_10.42.42.5(pid=6710): stderr: | 20221209012526858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012526858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012526859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012526859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012526859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012526860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012526860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:28.256757 run osmo-stp_10.42.42.5(pid=6710): stdout: | (launched: 2022-12-09_01:25:26.688016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:28.378569 run osmo-stp_10.42.42.5(pid=6710): stderr: | 20221209012526858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012526858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012526859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012526859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012526859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012526860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012526860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:28.522662 run patchelf(pid=6713): Terminating (SIGINT) 01:25:28.689435 run patchelf(pid=6713): Terminated: ok {rc=0} 01:25:28.810505 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6710): Process ended prematurely: osmo-stp_10.42.42.5(pid=6710) [trial-2352↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6710)] [trial-2352↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:25:28.819740 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 01:25:28.846789 run osmo-hlr_10.42.42.2(pid=6707): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6707)] 01:25:28.894209 run osmo-hlr_10.42.42.2(pid=6707): stdout: | (launched: 2022-12-09_01:25:25.788483) 01:25:28.943597 run osmo-hlr_10.42.42.2(pid=6707): stderr: | 20221209012525965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012525965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012525965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012525965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012525965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012525965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012525976 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012525985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012525985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012525985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:28.993486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6706): Terminating (SIGTERM) 01:25:29.033551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6709): Terminating (SIGTERM) 01:25:29.073206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6712): Terminating (SIGTERM) 01:25:29.113241 --- ParallelTerminationStrategy: PID 6706 died... 01:25:29.132197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6706): Terminated: ok {rc=0} 01:25:29.176669 --- ParallelTerminationStrategy: PID 6709 died... 01:25:29.195307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6709): Terminated: ok {rc=0} 01:25:29.239530 --- ParallelTerminationStrategy: PID 6712 died... 01:25:29.258200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6712): Terminated: ok {rc=0} 01:25:29.344197 bus /gobi_0: Setting Powered False 01:25:30.442329 bus /gobi_0: Setting Powered False 01:25:31.556231 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_sms:trx-lms --------------------------------------------------------------------- 01:25:32.800241 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:32.804108 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 01:25:32.837567 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 01:25:32.844240 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 01:25:32.895560 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 01:25:32.927995 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 01:25:32.934672 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 01:25:33.472540 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 01:25:33.477500 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 01:25:33.487992 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 01:25:33.535114 tst mo_mt_sms.py: using LAC 18102 01:25:33.652564 tst mo_mt_sms.py: using RAC 252 01:25:33.768030 tst mo_mt_sms.py: using CellId 18102 01:25:33.885307 tst mo_mt_sms.py: using BVCI 18103 01:25:34.000817 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 01:25:34.114525 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 01:25:34.226704 tst mo_mt_sms.py:9: start nitb and bts... 01:25:34.426095 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:25:35.028210 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6718): Launched 01:25:35.324581 run osmo-nitb_10.42.42.2(pid=6719): Launched 01:25:35.489190 run osmo-nitb_10.42.42.2(pid=6719): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6719)] 01:25:35.622189 run osmo-nitb_10.42.42.2(pid=6719): stdout: | (launched: 2022-12-09_01:25:35.270285) 01:25:35.756890 run osmo-nitb_10.42.42.2(pid=6719): stderr: | (launched: 2022-12-09_01:25:35.314488) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:25:35.892018 run osmo-nitb_10.42.42.2(pid=6719): stdout: | (launched: 2022-12-09_01:25:35.270285) 01:25:36.021600 run osmo-nitb_10.42.42.2(pid=6719): stderr: | (launched: 2022-12-09_01:25:35.314488) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6719): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6719) [trial-2352↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6719)] 01:25:36.436195 tst osmo-nitb_10.42.42.2(pid=6719): stdout: | (launched: 2022-12-09_01:25:35.270285) 01:25:36.556040 tst osmo-nitb_10.42.42.2(pid=6719): stderr: | (launched: 2022-12-09_01:25:35.314488) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:25:36.697601 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6719): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6719) [trial-2352↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6719)] [trial-2352↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 01:25:36.706167 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 01:25:36.712934 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6718): Terminating (SIGTERM) 01:25:36.922028 --- ParallelTerminationStrategy: PID 6718 died... 01:25:36.942980 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6718): Terminated: ok {rc=0} 01:25:37.029746 bus /sierra_3: Setting Powered False 01:25:38.129796 bus /sierra_3: Setting Powered False 01:25:39.247334 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 sms:trx-lms --------------------------------------------------------------------- 01:25:40.448194 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:40.452376 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 01:25:40.486616 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 01:25:40.514150 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 01:25:40.566960 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 01:25:40.600787 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 01:25:40.628157 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 01:25:41.179187 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 01:25:41.184245 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:41.195213 tst sms:trx-lms: Using 1 x bts (candidates: 1) 01:25:41.243850 tst mo_mt_sms.py: using LAC 18103 01:25:41.367086 tst mo_mt_sms.py: using RAC 253 01:25:41.492817 tst mo_mt_sms.py: using CellId 18103 01:25:41.621304 tst mo_mt_sms.py: using BVCI 18104 01:25:41.736679 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:41.747634 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:41.758518 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:41.769351 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:41.780194 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:41.790945 tst sms:trx-lms: Using 1 x modem (candidates: 2) 01:25:41.906515 tst sms:trx-lms: Using 1 x modem (candidates: 2) 01:25:42.021306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:42.512115 run create_hlr_db(pid=6723): Launched 01:25:42.640482 bus /sierra_2: Setting Powered False 01:25:43.703582 run create_hlr_db(pid=6723): Terminated: ok {rc=0} 01:25:44.144755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6725): Launched 01:25:44.460823 run osmo-hlr_10.42.42.2(pid=6726): Launched 01:25:44.583253 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:45.128410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6728): Launched 01:25:45.444821 run osmo-stp_10.42.42.5(pid=6729): Launched 01:25:45.567878 run osmo-msc_10.42.42.6: Starting osmo-msc 01:25:46.177764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6731): Launched 01:25:46.510133 run osmo-msc_10.42.42.6(pid=6732): Launched 01:25:46.851768 run osmo-stp_10.42.42.5(pid=6729): ERR: Terminated: ERROR {rc=1} [trial-2352↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6729)] 01:25:47.047059 run osmo-stp_10.42.42.5(pid=6729): stdout: | (launched: 2022-12-09_01:25:45.387388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:47.206163 run osmo-stp_10.42.42.5(pid=6729): stderr: | 20221209012545579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012545580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012545580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012545580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012545581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012545581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012545581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:47.363860 run osmo-stp_10.42.42.5(pid=6729): stdout: | (launched: 2022-12-09_01:25:45.387388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:47.490536 run osmo-stp_10.42.42.5(pid=6729): stderr: | 20221209012545579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012545580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012545580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012545580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012545581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012545581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012545581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:47.641466 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6729): Process ended prematurely: osmo-stp_10.42.42.5(pid=6729) [trial-2352↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6729)] [trial-2352↪sms:trx-lms↪mo_mt_sms.py:16] 01:25:47.650522 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 01:25:47.678250 run osmo-hlr_10.42.42.2(pid=6726): ERR: Terminated: ERROR {rc=237} [trial-2352↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6726)] 01:25:47.729071 run osmo-hlr_10.42.42.2(pid=6726): stdout: | (launched: 2022-12-09_01:25:44.403213) 01:25:47.781716 run osmo-hlr_10.42.42.2(pid=6726): stderr: | 20221209012544600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012544600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012544600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012544601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012544601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012544601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012544614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012544622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012544622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012544622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:47.854545 run osmo-msc_10.42.42.6(pid=6732): ERR: Terminated: ERROR {rc=2} [trial-2352↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6732)] 01:25:47.904861 run osmo-msc_10.42.42.6(pid=6732): stdout: | (launched: 2022-12-09_01:25:46.450391) 01:25:47.957467 run osmo-msc_10.42.42.6(pid=6732): stderr: | 20221209012546921 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012546921 DLGLOBAL DEBUG validating counter group 0x7f94d3158c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012546921 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012546921 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012546921 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012546922 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012546923 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012546924 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012546924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012546924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:25:48.010044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6725): Terminating (SIGTERM) 01:25:48.052093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6728): Terminating (SIGTERM) 01:25:48.094163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6731): Terminating (SIGTERM) 01:25:48.136378 --- ParallelTerminationStrategy: PID 6725 died... 01:25:48.156477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6725): Terminated: ok {rc=0} 01:25:48.202991 --- ParallelTerminationStrategy: PID 6728 died... 01:25:48.222641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6728): Terminated: ok {rc=0} 01:25:48.269157 --- ParallelTerminationStrategy: PID 6731 died... 01:25:48.288860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6731): Terminated: ok {rc=0} 01:25:48.377457 bus /sierra_3: Setting Powered False 01:25:49.477558 bus /sierra_3: Setting Powered False 01:25:50.593346 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_ussd:trx-lms --------------------------------------------------------------------- 01:25:51.817964 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:51.822661 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 01:25:51.856853 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 01:25:51.863920 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 01:25:51.900066 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 01:25:51.933751 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 01:25:51.940619 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 01:25:52.461889 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2352 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 01:25:52.466952 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 01:25:52.478477 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 01:25:52.526860 tst assert_extension.py: using LAC 18104 01:25:52.652602 tst assert_extension.py: using RAC 254 01:25:52.776568 tst assert_extension.py: using CellId 18104 01:25:52.901039 tst assert_extension.py: using BVCI 18105 01:25:53.015459 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 01:25:53.134362 tst assert_extension.py:10: start nitb and bts... 01:25:53.349014 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:25:53.997890 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6737): Launched 01:25:54.314785 run osmo-nitb_10.42.42.2(pid=6738): Launched 01:25:54.492716 run osmo-nitb_10.42.42.2(pid=6738): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6738)] 01:25:54.635371 run osmo-nitb_10.42.42.2(pid=6738): stdout: | (launched: 2022-12-09_01:25:54.257283) 01:25:54.779141 run osmo-nitb_10.42.42.2(pid=6738): stderr: | (launched: 2022-12-09_01:25:54.304599) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:25:54.922894 run osmo-nitb_10.42.42.2(pid=6738): stdout: | (launched: 2022-12-09_01:25:54.257283) 01:25:55.061085 run osmo-nitb_10.42.42.2(pid=6738): stderr: | (launched: 2022-12-09_01:25:54.304599) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6738): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6738) [trial-2352↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6738)] 01:25:55.436568 tst osmo-nitb_10.42.42.2(pid=6738): stdout: | (launched: 2022-12-09_01:25:54.257283) 01:25:55.565469 tst osmo-nitb_10.42.42.2(pid=6738): stderr: | (launched: 2022-12-09_01:25:54.304599) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:25:55.716386 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6738): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6738) [trial-2352↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6738)] [trial-2352↪nitb_ussd:trx-lms↪assert_extension.py:12] 01:25:55.725548 tst assert_extension.py:12: Test FAILED (3.3 sec) 01:25:55.732461 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6737): Terminating (SIGTERM) 01:25:55.943177 --- ParallelTerminationStrategy: PID 6737 died... 01:25:55.964810 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6737): Terminated: ok {rc=0} 01:25:56.054164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 ussd:trx-lms --------------------------------------------------------------------- 01:25:57.230287 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:57.234061 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 01:25:57.267190 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 01:25:57.293391 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 01:25:57.329529 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 01:25:57.363715 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 01:25:57.391364 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 01:25:57.914960 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2352 ussd:trx-lms assert_extension.py ---------------------------------------------- 01:25:57.920442 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:57.931097 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 01:25:57.979209 tst assert_extension.py: using LAC 18105 01:25:58.105743 tst assert_extension.py: using RAC 255 01:25:58.229175 tst assert_extension.py: using CellId 18105 01:25:58.352829 tst assert_extension.py: using BVCI 18106 01:25:58.467108 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:58.478194 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:58.489527 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:58.500319 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:58.511275 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:58.522072 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 01:25:58.633267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:59.091566 run create_hlr_db(pid=6742): Launched 01:25:59.205641 bus /sierra_2: Setting Powered False 01:26:00.268591 run create_hlr_db(pid=6742): Terminated: ok {rc=0} 01:26:00.712343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6744): Launched 01:26:01.042963 run osmo-hlr_10.42.42.2(pid=6745): Launched 01:26:01.280820 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:01.945820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6747): Launched 01:26:02.272285 run osmo-stp_10.42.42.5(pid=6748): Launched 01:26:02.394314 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:02.968536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6750): Launched 01:26:03.285194 run osmo-msc_10.42.42.6(pid=6751): Launched 01:26:03.461599 run osmo-stp_10.42.42.5(pid=6748): ERR: Terminated: ERROR {rc=1} [trial-2352↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6748)] 01:26:03.594948 run osmo-stp_10.42.42.5(pid=6748): stdout: | (launched: 2022-12-09_01:26:02.214636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:03.729208 run osmo-stp_10.42.42.5(pid=6748): stderr: | 20221209012602404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012602404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012602405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012602405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012602405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012602406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012602406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:03.863339 run osmo-stp_10.42.42.5(pid=6748): stdout: | (launched: 2022-12-09_01:26:02.214636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:03.989447 run osmo-stp_10.42.42.5(pid=6748): stderr: | 20221209012602404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012602404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012602405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012602405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012602405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012602406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012602406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:04.141199 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6748): Process ended prematurely: osmo-stp_10.42.42.5(pid=6748) [trial-2352↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6748)] [trial-2352↪ussd:trx-lms↪assert_extension.py:17] 01:26:04.150399 tst assert_extension.py:17: Test FAILED (6.2 sec) 01:26:04.178013 run osmo-hlr_10.42.42.2(pid=6745): ERR: Terminated: ERROR {rc=237} [trial-2352↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6745)] 01:26:04.228140 run osmo-hlr_10.42.42.2(pid=6745): stdout: | (launched: 2022-12-09_01:26:00.985439) 01:26:04.280141 run osmo-hlr_10.42.42.2(pid=6745): stderr: | 20221209012601289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012601289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012601289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012601289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012601289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012601290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012601307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012601315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012601315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012601315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:04.352548 run osmo-msc_10.42.42.6(pid=6751): ERR: Terminated: ERROR {rc=2} [trial-2352↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6751)] 01:26:04.402588 run osmo-msc_10.42.42.6(pid=6751): stdout: | (launched: 2022-12-09_01:26:03.227051) 01:26:04.454498 run osmo-msc_10.42.42.6(pid=6751): stderr: | 20221209012603550 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012603550 DLGLOBAL DEBUG validating counter group 0x7f37cd8ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012603550 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012603550 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012603550 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012603551 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012603552 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012603553 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012603553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012603553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:04.507212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6744): Terminating (SIGTERM) 01:26:04.549160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6747): Terminating (SIGTERM) 01:26:04.591062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6750): Terminating (SIGTERM) 01:26:04.633329 --- ParallelTerminationStrategy: PID 6744 died... 01:26:04.653657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6744): Terminated: ok {rc=0} 01:26:04.700721 --- ParallelTerminationStrategy: PID 6747 died... 01:26:04.720679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6747): Terminated: ok {rc=0} 01:26:04.767537 --- ParallelTerminationStrategy: PID 6750 died... 01:26:04.787502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6750): Terminated: ok {rc=0} 01:26:04.877119 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:26:06.090393 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:26:06.096793 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:26:06.133141 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:26:06.160516 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:26:06.213564 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:26:06.247508 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:26:06.273734 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:26:06.823073 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:26:06.873732 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:06.884558 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:26:06.952202 tst mo_mt_call.py: using LAC 18106 01:26:07.070372 tst mo_mt_call.py: using RAC 1 01:26:07.187945 tst mo_mt_call.py: using CellId 18106 01:26:07.305606 tst mo_mt_call.py: using BVCI 18107 01:26:07.423681 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:07.435266 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:07.446741 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:07.458223 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:07.469687 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:07.481072 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:26:07.597917 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:26:07.718026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:08.218847 run create_hlr_db(pid=6757): Launched 01:26:08.351833 bus /sierra_2: Setting Powered False 01:26:09.416328 run create_hlr_db(pid=6757): Terminated: ok {rc=0} 01:26:09.848455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6759): Launched 01:26:10.150623 run osmo-hlr_10.42.42.2(pid=6760): Launched 01:26:10.265795 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:10.801471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6762): Launched 01:26:11.104454 run osmo-stp_10.42.42.5(pid=6763): Launched 01:26:11.219901 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:11.766281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6765): Launched 01:26:12.068127 run osmo-msc_10.42.42.6(pid=6766): Launched 01:26:12.238109 run osmo-stp_10.42.42.5(pid=6763): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6763)] 01:26:12.366107 run osmo-stp_10.42.42.5(pid=6763): stdout: | (launched: 2022-12-09_01:26:11.049214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:12.493942 run osmo-stp_10.42.42.5(pid=6763): stderr: | 20221209012611218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012611218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012611218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012611219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012611219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012611219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012611219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:12.619550 run osmo-stp_10.42.42.5(pid=6763): stdout: | (launched: 2022-12-09_01:26:11.049214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:12.739134 run osmo-stp_10.42.42.5(pid=6763): stderr: | 20221209012611218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012611218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012611218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012611219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012611219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012611219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012611219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:12.882958 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6763): Process ended prematurely: osmo-stp_10.42.42.5(pid=6763) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6763)] [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:26:12.891728 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:26:12.918058 run osmo-hlr_10.42.42.2(pid=6760): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6760)] 01:26:12.966244 run osmo-hlr_10.42.42.2(pid=6760): stdout: | (launched: 2022-12-09_01:26:10.095418) 01:26:13.016014 run osmo-hlr_10.42.42.2(pid=6760): stderr: | 20221209012610273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012610273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012610273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012610273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012610273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012610273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012610285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012610295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012610295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012610295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:13.085282 run osmo-msc_10.42.42.6(pid=6766): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6766)] 01:26:13.133570 run osmo-msc_10.42.42.6(pid=6766): stdout: | (launched: 2022-12-09_01:26:12.013052) 01:26:13.183358 run osmo-msc_10.42.42.6(pid=6766): stderr: | 20221209012612284 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012612284 DLGLOBAL DEBUG validating counter group 0x7ff6033fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012612284 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012612284 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012612284 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012612284 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012612286 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012612286 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012612287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012612287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:13.233658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6759): Terminating (SIGTERM) 01:26:13.273875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6762): Terminating (SIGTERM) 01:26:13.314110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6765): Terminating (SIGTERM) 01:26:13.353992 --- ParallelTerminationStrategy: PID 6759 died... 01:26:13.373411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6759): Terminated: ok {rc=0} 01:26:13.417664 --- ParallelTerminationStrategy: PID 6762 died... 01:26:13.436340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6762): Terminated: ok {rc=0} 01:26:13.481168 --- ParallelTerminationStrategy: PID 6765 died... 01:26:13.500173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6765): Terminated: ok {rc=0} 01:26:13.585886 bus /sierra_3: Setting Powered False 01:26:14.681482 bus /sierra_3: Setting Powered False 01:26:15.799111 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:26:16.954876 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:16.967205 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:26:17.037374 tst mo_mt_call_osmux.py: using LAC 18107 01:26:17.161681 tst mo_mt_call_osmux.py: using RAC 2 01:26:17.283839 tst mo_mt_call_osmux.py: using CellId 18107 01:26:17.411612 tst mo_mt_call_osmux.py: using BVCI 18108 01:26:17.531306 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:17.542964 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:17.554286 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:17.565762 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:17.577202 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:26:17.588542 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:26:17.708327 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:26:17.830723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:18.301529 run create_hlr_db(pid=6768): Launched 01:26:18.417891 bus /sierra_2: Setting Powered False 01:26:19.479264 run create_hlr_db(pid=6768): Terminated: ok {rc=0} 01:26:19.900010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6770): Launched 01:26:20.203192 run osmo-hlr_10.42.42.2(pid=6771): Launched 01:26:20.320296 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:20.860297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6773): Launched 01:26:21.184903 run osmo-stp_10.42.42.5(pid=6774): Launched 01:26:21.309762 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:21.912278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6776): Launched 01:26:22.223162 run osmo-msc_10.42.42.6(pid=6777): Launched 01:26:22.392258 run osmo-stp_10.42.42.5(pid=6774): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6774)] 01:26:22.520312 run osmo-stp_10.42.42.5(pid=6774): stdout: | (launched: 2022-12-09_01:26:21.126543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:22.648808 run osmo-stp_10.42.42.5(pid=6774): stderr: | 20221209012621319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012621319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012621319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012621320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012621320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012621320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012621320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:22.774869 run osmo-stp_10.42.42.5(pid=6774): stdout: | (launched: 2022-12-09_01:26:21.126543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:22.895104 run osmo-stp_10.42.42.5(pid=6774): stderr: | 20221209012621319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012621319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012621319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012621320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012621320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012621320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012621320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:23.039051 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6774): Process ended prematurely: osmo-stp_10.42.42.5(pid=6774) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6774)] [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:26:23.047993 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:26:23.074994 run osmo-hlr_10.42.42.2(pid=6771): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6771)] 01:26:23.122889 run osmo-hlr_10.42.42.2(pid=6771): stdout: | (launched: 2022-12-09_01:26:20.147649) 01:26:23.172658 run osmo-hlr_10.42.42.2(pid=6771): stderr: | 20221209012620326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012620326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012620326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012620326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012620326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012620326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012620338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012620347 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012620347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012620347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:23.241795 run osmo-msc_10.42.42.6(pid=6777): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6777)] 01:26:23.289675 run osmo-msc_10.42.42.6(pid=6777): stdout: | (launched: 2022-12-09_01:26:22.167840) 01:26:23.339130 run osmo-msc_10.42.42.6(pid=6777): stderr: | 20221209012622439 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012622439 DLGLOBAL DEBUG validating counter group 0x7f2511e05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012622439 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012622440 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012622440 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012622440 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012622442 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012622443 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012622443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012622443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:23.388688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6770): Terminating (SIGTERM) 01:26:23.428308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6773): Terminating (SIGTERM) 01:26:23.468109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6776): Terminating (SIGTERM) 01:26:23.507827 --- ParallelTerminationStrategy: PID 6770 died... 01:26:23.526846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6770): Terminated: ok {rc=0} 01:26:23.571134 --- ParallelTerminationStrategy: PID 6773 died... 01:26:23.589608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6773): Terminated: ok {rc=0} 01:26:23.633648 --- ParallelTerminationStrategy: PID 6776 died... 01:26:23.652214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6776): Terminated: ok {rc=0} 01:26:23.739719 bus /sierra_3: Setting Powered False 01:26:24.841050 bus /sierra_3: Setting Powered False 01:26:25.958454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:26:27.214423 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:26:27.221524 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:26:27.255658 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:26:27.283104 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:26:27.337612 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:26:27.372098 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:26:27.399305 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:26:27.949636 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:26:28.001499 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:28.012903 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:26:28.084253 tst mo_mt_call.py: using LAC 18108 01:26:28.212383 tst mo_mt_call.py: using RAC 3 01:26:28.340781 tst mo_mt_call.py: using CellId 18108 01:26:28.469108 tst mo_mt_call.py: using BVCI 18109 01:26:28.588021 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:28.599490 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:28.610861 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:28.622183 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:28.633738 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:28.645024 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:26:28.764461 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:26:28.879794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:29.347344 run create_hlr_db(pid=6783): Launched 01:26:29.463416 bus /sierra_2: Setting Powered False 01:26:30.528222 run create_hlr_db(pid=6783): Terminated: ok {rc=0} 01:26:31.013707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6785): Launched 01:26:31.352692 run osmo-hlr_10.42.42.2(pid=6786): Launched 01:26:31.659678 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:32.333622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6788): Launched 01:26:32.638051 run osmo-stp_10.42.42.5(pid=6789): Launched 01:26:32.753770 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:33.303012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6791): Launched 01:26:33.606571 run osmo-msc_10.42.42.6(pid=6792): Launched 01:26:33.775816 run osmo-stp_10.42.42.5(pid=6789): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6789)] 01:26:33.904885 run osmo-stp_10.42.42.5(pid=6789): stdout: | (launched: 2022-12-09_01:26:32.582041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:34.032436 run osmo-stp_10.42.42.5(pid=6789): stderr: | 20221209012632752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012632752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012632752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012632753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012632753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012632753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012632753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:34.158886 run osmo-stp_10.42.42.5(pid=6789): stdout: | (launched: 2022-12-09_01:26:32.582041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:34.278741 run osmo-stp_10.42.42.5(pid=6789): stderr: | 20221209012632752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012632752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012632752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012632753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012632753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012632753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012632753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:34.423327 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6789): Process ended prematurely: osmo-stp_10.42.42.5(pid=6789) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6789)] [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:26:34.432321 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 01:26:34.459495 run osmo-hlr_10.42.42.2(pid=6786): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6786)] 01:26:34.507653 run osmo-hlr_10.42.42.2(pid=6786): stdout: | (launched: 2022-12-09_01:26:31.293410) 01:26:34.557660 run osmo-hlr_10.42.42.2(pid=6786): stderr: | 20221209012631636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012631636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012631636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012631636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012631636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012631636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012631652 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012631662 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012631662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012631662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:34.627526 run osmo-msc_10.42.42.6(pid=6792): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6792)] 01:26:34.675500 run osmo-msc_10.42.42.6(pid=6792): stdout: | (launched: 2022-12-09_01:26:33.551017) 01:26:34.725059 run osmo-msc_10.42.42.6(pid=6792): stderr: | 20221209012633823 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012633823 DLGLOBAL DEBUG validating counter group 0x7f1d0a8d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012633823 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012633823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012633824 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012633824 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012633826 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012633826 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012633827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012633827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:34.775044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6785): Terminating (SIGTERM) 01:26:34.815180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6788): Terminating (SIGTERM) 01:26:34.855196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6791): Terminating (SIGTERM) 01:26:34.895200 --- ParallelTerminationStrategy: PID 6785 died... 01:26:34.914211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6785): Terminated: ok {rc=0} 01:26:34.958742 --- ParallelTerminationStrategy: PID 6788 died... 01:26:34.977377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6788): Terminated: ok {rc=0} 01:26:35.022207 --- ParallelTerminationStrategy: PID 6791 died... 01:26:35.041054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6791): Terminated: ok {rc=0} 01:26:35.127428 bus /sierra_3: Setting Powered False 01:26:36.228611 bus /sierra_3: Setting Powered False 01:26:37.344709 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:26:38.492879 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:38.504662 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:26:38.575955 tst mo_mt_call_osmux.py: using LAC 18109 01:26:38.696326 tst mo_mt_call_osmux.py: using RAC 4 01:26:38.816152 tst mo_mt_call_osmux.py: using CellId 18109 01:26:38.936371 tst mo_mt_call_osmux.py: using BVCI 18110 01:26:39.047277 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:39.058346 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:39.069165 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:39.080106 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:39.091275 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:39.102314 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:26:39.219388 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:26:39.341109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:39.842185 run create_hlr_db(pid=6794): Launched 01:26:39.975530 bus /sierra_2: Setting Powered False 01:26:41.039345 run create_hlr_db(pid=6794): Terminated: ok {rc=0} 01:26:41.489773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6796): Launched 01:26:41.813662 run osmo-hlr_10.42.42.2(pid=6797): Launched 01:26:41.938607 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:42.495714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6799): Launched 01:26:42.818654 run osmo-stp_10.42.42.5(pid=6800): Launched 01:26:42.941593 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:43.526233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6802): Launched 01:26:43.850252 run osmo-msc_10.42.42.6(pid=6803): Launched 01:26:44.031032 run osmo-stp_10.42.42.5(pid=6800): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6800)] 01:26:44.167481 run osmo-stp_10.42.42.5(pid=6800): stdout: | (launched: 2022-12-09_01:26:42.760088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:44.304273 run osmo-stp_10.42.42.5(pid=6800): stderr: | 20221209012642952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012642952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012642952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012642953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012642953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012642953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012642953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:44.441314 run osmo-stp_10.42.42.5(pid=6800): stdout: | (launched: 2022-12-09_01:26:42.760088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:44.570469 run osmo-stp_10.42.42.5(pid=6800): stderr: | 20221209012642952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012642952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012642952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012642953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012642953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012642953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012642953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:44.724782 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6800): Process ended prematurely: osmo-stp_10.42.42.5(pid=6800) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6800)] [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:26:44.734503 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:26:44.762553 run osmo-hlr_10.42.42.2(pid=6797): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6797)] 01:26:44.813244 run osmo-hlr_10.42.42.2(pid=6797): stdout: | (launched: 2022-12-09_01:26:41.755102) 01:26:44.865184 run osmo-hlr_10.42.42.2(pid=6797): stderr: | 20221209012641954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012641954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012641954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012641954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012641954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012641954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012641966 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012641975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012641975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012641975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:44.937454 run osmo-msc_10.42.42.6(pid=6803): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6803)] 01:26:44.987661 run osmo-msc_10.42.42.6(pid=6803): stdout: | (launched: 2022-12-09_01:26:43.791697) 01:26:45.039336 run osmo-msc_10.42.42.6(pid=6803): stderr: | 20221209012644114 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012644115 DLGLOBAL DEBUG validating counter group 0x7f538478fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012644115 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012644115 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012644115 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012644115 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012644117 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012644117 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012644117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012644118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:45.091325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6796): Terminating (SIGTERM) 01:26:45.132915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6799): Terminating (SIGTERM) 01:26:45.174750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6802): Terminating (SIGTERM) 01:26:45.216727 --- ParallelTerminationStrategy: PID 6796 died... 01:26:45.236734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6796): Terminated: ok {rc=0} 01:26:45.282888 --- ParallelTerminationStrategy: PID 6799 died... 01:26:45.302495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6799): Terminated: ok {rc=0} 01:26:45.348550 --- ParallelTerminationStrategy: PID 6802 died... 01:26:45.368178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6802): Terminated: ok {rc=0} 01:26:45.455667 bus /sierra_3: Setting Powered False 01:26:46.557782 bus /sierra_3: Setting Powered False 01:26:47.680925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:26:48.932348 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:26:48.939180 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:26:48.972603 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:26:48.998706 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:26:49.051974 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:26:49.084928 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:26:49.111306 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:26:49.659114 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:26:49.708307 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:49.719409 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:26:49.787972 tst mo_mt_call.py: using LAC 18110 01:26:49.907540 tst mo_mt_call.py: using RAC 5 01:26:50.027298 tst mo_mt_call.py: using CellId 18110 01:26:50.151177 tst mo_mt_call.py: using BVCI 18111 01:26:50.270528 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:50.282330 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:50.293947 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:50.305902 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:50.317569 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:50.329066 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:26:50.444664 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:26:50.565084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:51.031747 run create_hlr_db(pid=6808): Launched 01:26:51.149683 bus /sierra_2: Setting Powered False 01:26:52.210405 run create_hlr_db(pid=6808): Terminated: ok {rc=0} 01:26:52.633717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6810): Launched 01:26:52.939728 run osmo-hlr_10.42.42.2(pid=6811): Launched 01:26:53.055605 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:53.594059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6813): Launched 01:26:53.897271 run osmo-stp_10.42.42.5(pid=6814): Launched 01:26:54.014229 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:54.563588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6816): Launched 01:26:54.866974 run osmo-msc_10.42.42.6(pid=6817): Launched 01:26:55.036859 run osmo-stp_10.42.42.5(pid=6814): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6814)] 01:26:55.165444 run osmo-stp_10.42.42.5(pid=6814): stdout: | (launched: 2022-12-09_01:26:53.841904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:55.293837 run osmo-stp_10.42.42.5(pid=6814): stderr: | 20221209012654010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012654010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012654010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012654011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012654011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012654011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012654011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:55.420032 run osmo-stp_10.42.42.5(pid=6814): stdout: | (launched: 2022-12-09_01:26:53.841904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:55.539916 run osmo-stp_10.42.42.5(pid=6814): stderr: | 20221209012654010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012654010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012654010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012654011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012654011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012654011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012654011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:55.683575 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6814): Process ended prematurely: osmo-stp_10.42.42.5(pid=6814) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6814)] [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:26:55.692546 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:26:55.719450 run osmo-hlr_10.42.42.2(pid=6811): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6811)] 01:26:55.767480 run osmo-hlr_10.42.42.2(pid=6811): stdout: | (launched: 2022-12-09_01:26:52.884372) 01:26:55.817427 run osmo-hlr_10.42.42.2(pid=6811): stderr: | 20221209012653061 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012653061 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012653061 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012653061 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012653061 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012653061 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012653073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012653081 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012653082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012653082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:55.886868 run osmo-msc_10.42.42.6(pid=6817): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6817)] 01:26:55.934995 run osmo-msc_10.42.42.6(pid=6817): stdout: | (launched: 2022-12-09_01:26:54.811448) 01:26:55.984698 run osmo-msc_10.42.42.6(pid=6817): stderr: | 20221209012655087 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012655087 DLGLOBAL DEBUG validating counter group 0x7f035a2cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012655087 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012655087 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012655087 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012655087 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012655089 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012655090 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012655090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012655090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:56.034980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6810): Terminating (SIGTERM) 01:26:56.075136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6813): Terminating (SIGTERM) 01:26:56.115210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6816): Terminating (SIGTERM) 01:26:56.155327 --- ParallelTerminationStrategy: PID 6810 died... 01:26:56.174410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6810): Terminated: ok {rc=0} 01:26:56.218896 --- ParallelTerminationStrategy: PID 6813 died... 01:26:56.237400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6813): Terminated: ok {rc=0} 01:26:56.282165 --- ParallelTerminationStrategy: PID 6816 died... 01:26:56.300775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6816): Terminated: ok {rc=0} 01:26:56.387001 bus /sierra_3: Setting Powered False 01:26:57.487890 bus /sierra_3: Setting Powered False 01:26:58.605242 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:26:59.751136 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:59.762828 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:26:59.837112 tst mo_mt_call_osmux.py: using LAC 18111 01:26:59.956200 tst mo_mt_call_osmux.py: using RAC 6 01:27:00.077999 tst mo_mt_call_osmux.py: using CellId 18111 01:27:00.198265 tst mo_mt_call_osmux.py: using BVCI 18112 01:27:00.310630 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:27:00.321845 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:27:00.332581 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:27:00.344060 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:27:00.355577 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:27:00.367237 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:27:00.483513 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:27:00.606298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:01.166642 run create_hlr_db(pid=6819): Launched 01:27:01.319975 bus /sierra_2: Setting Powered False 01:27:02.383386 run create_hlr_db(pid=6819): Terminated: ok {rc=0} 01:27:02.841069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6821): Launched 01:27:03.143894 run osmo-hlr_10.42.42.2(pid=6822): Launched 01:27:03.261830 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:03.791519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6824): Launched 01:27:04.093598 run osmo-stp_10.42.42.5(pid=6825): Launched 01:27:04.208895 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:04.757878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6827): Launched 01:27:05.060911 run osmo-msc_10.42.42.6(pid=6828): Launched 01:27:05.231245 run osmo-stp_10.42.42.5(pid=6825): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6825)] 01:27:05.363771 run osmo-stp_10.42.42.5(pid=6825): stdout: | (launched: 2022-12-09_01:27:04.038143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:05.491899 run osmo-stp_10.42.42.5(pid=6825): stderr: | 20221209012704208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012704209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012704209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012704209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012704210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012704210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012704210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:05.617648 run osmo-stp_10.42.42.5(pid=6825): stdout: | (launched: 2022-12-09_01:27:04.038143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:05.737397 run osmo-stp_10.42.42.5(pid=6825): stderr: | 20221209012704208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012704209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012704209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012704209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012704210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012704210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012704210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:05.881353 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6825): Process ended prematurely: osmo-stp_10.42.42.5(pid=6825) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6825)] [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:27:05.890133 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:27:05.917247 run osmo-hlr_10.42.42.2(pid=6822): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6822)] 01:27:05.965181 run osmo-hlr_10.42.42.2(pid=6822): stdout: | (launched: 2022-12-09_01:27:03.088641) 01:27:06.014804 run osmo-hlr_10.42.42.2(pid=6822): stderr: | 20221209012703265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012703265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012703265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012703265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012703265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012703265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012703277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012703286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012703287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012703287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:06.083801 run osmo-msc_10.42.42.6(pid=6828): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6828)] 01:27:06.131729 run osmo-msc_10.42.42.6(pid=6828): stdout: | (launched: 2022-12-09_01:27:05.004665) 01:27:06.181217 run osmo-msc_10.42.42.6(pid=6828): stderr: | 20221209012705281 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012705281 DLGLOBAL DEBUG validating counter group 0x7f12eb48dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012705281 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012705281 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012705281 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012705281 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012705284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012705284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012705284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012705284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:06.230925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6821): Terminating (SIGTERM) 01:27:06.270613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6824): Terminating (SIGTERM) 01:27:06.310312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6827): Terminating (SIGTERM) 01:27:06.350098 --- ParallelTerminationStrategy: PID 6821 died... 01:27:06.369183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6821): Terminated: ok {rc=0} 01:27:06.413720 --- ParallelTerminationStrategy: PID 6824 died... 01:27:06.432208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6824): Terminated: ok {rc=0} 01:27:06.476387 --- ParallelTerminationStrategy: PID 6827 died... 01:27:06.494930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6827): Terminated: ok {rc=0} 01:27:06.582231 bus /sierra_3: Setting Powered False 01:27:07.680781 bus /sierra_3: Setting Powered False 01:27:08.796436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:27:10.044451 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:27:10.051420 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:27:10.084455 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:27:10.110895 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:27:10.163734 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:27:10.197954 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:27:10.225554 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:27:10.777138 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:27:10.829443 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:10.841128 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:27:10.912670 tst mo_mt_call.py: using LAC 18112 01:27:11.040720 tst mo_mt_call.py: using RAC 7 01:27:11.169156 tst mo_mt_call.py: using CellId 18112 01:27:11.296026 tst mo_mt_call.py: using BVCI 18113 01:27:11.414702 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:11.426344 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:11.437738 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:11.449197 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:11.460588 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:11.472033 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:27:11.586058 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:27:11.700920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:12.168686 run create_hlr_db(pid=6833): Launched 01:27:12.287281 bus /sierra_2: Setting Powered False 01:27:13.347528 run create_hlr_db(pid=6833): Terminated: ok {rc=0} 01:27:13.768334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6835): Launched 01:27:14.070406 run osmo-hlr_10.42.42.2(pid=6836): Launched 01:27:14.186496 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:14.723264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6838): Launched 01:27:15.025418 run osmo-stp_10.42.42.5(pid=6839): Launched 01:27:15.142477 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:15.692507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6841): Launched 01:27:16.010357 run osmo-msc_10.42.42.6(pid=6842): Launched 01:27:16.304320 run osmo-stp_10.42.42.5(pid=6839): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6839)] 01:27:16.500621 run osmo-stp_10.42.42.5(pid=6839): stdout: | (launched: 2022-12-09_01:27:14.969824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:16.771605 run osmo-stp_10.42.42.5(pid=6839): stderr: | 20221209012715140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012715140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012715140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012715141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012715141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012715141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012715141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:17.024900 run osmo-stp_10.42.42.5(pid=6839): stdout: | (launched: 2022-12-09_01:27:14.969824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:17.157519 run osmo-stp_10.42.42.5(pid=6839): stderr: | 20221209012715140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012715140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012715140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012715141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012715141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012715141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012715141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:17.316094 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6839): Process ended prematurely: osmo-stp_10.42.42.5(pid=6839) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6839)] [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:27:17.326879 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 01:27:17.356700 run osmo-hlr_10.42.42.2(pid=6836): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6836)] 01:27:17.407842 run osmo-hlr_10.42.42.2(pid=6836): stdout: | (launched: 2022-12-09_01:27:14.015231) 01:27:17.460303 run osmo-hlr_10.42.42.2(pid=6836): stderr: | 20221209012714192 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012714192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012714192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012714192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012714192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012714192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012714204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012714213 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012714213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012714213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:17.533473 run osmo-msc_10.42.42.6(pid=6842): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6842)] 01:27:17.584275 run osmo-msc_10.42.42.6(pid=6842): stdout: | (launched: 2022-12-09_01:27:15.949829) 01:27:17.636461 run osmo-msc_10.42.42.6(pid=6842): stderr: | 20221209012716573 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012716573 DLGLOBAL DEBUG validating counter group 0x7fd4b2639c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012716574 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012716574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012716574 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012716574 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012716576 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012716576 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012716576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012716576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:17.689244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6835): Terminating (SIGTERM) 01:27:17.731322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6838): Terminating (SIGTERM) 01:27:17.773542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6841): Terminating (SIGTERM) 01:27:17.815850 --- ParallelTerminationStrategy: PID 6835 died... 01:27:17.836098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6835): Terminated: ok {rc=0} 01:27:17.883075 --- ParallelTerminationStrategy: PID 6838 died... 01:27:17.902928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6838): Terminated: ok {rc=0} 01:27:17.950008 --- ParallelTerminationStrategy: PID 6841 died... 01:27:17.970026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6841): Terminated: ok {rc=0} 01:27:18.059604 bus /sierra_3: Setting Powered False 01:27:19.161347 bus /sierra_3: Setting Powered False 01:27:20.280001 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:27:21.431149 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:21.443663 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:27:21.514597 tst mo_mt_call_osmux.py: using LAC 18113 01:27:21.640376 tst mo_mt_call_osmux.py: using RAC 8 01:27:21.765138 tst mo_mt_call_osmux.py: using CellId 18113 01:27:21.890161 tst mo_mt_call_osmux.py: using BVCI 18114 01:27:22.007095 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:22.018784 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:22.030250 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:22.041662 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:22.053071 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:22.064433 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:27:22.181195 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:27:22.296679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:22.767349 run create_hlr_db(pid=6844): Launched 01:27:22.884573 bus /sierra_2: Setting Powered False 01:27:23.945409 run create_hlr_db(pid=6844): Terminated: ok {rc=0} 01:27:24.388391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6846): Launched 01:27:24.714790 run osmo-hlr_10.42.42.2(pid=6847): Launched 01:27:24.838818 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:25.396852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6849): Launched 01:27:25.720784 run osmo-stp_10.42.42.5(pid=6850): Launched 01:27:25.847616 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:26.434156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6852): Launched 01:27:26.761562 run osmo-msc_10.42.42.6(pid=6853): Launched 01:27:26.942839 run osmo-stp_10.42.42.5(pid=6850): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6850)] 01:27:27.079582 run osmo-stp_10.42.42.5(pid=6850): stdout: | (launched: 2022-12-09_01:27:25.662057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:27.216595 run osmo-stp_10.42.42.5(pid=6850): stderr: | 20221209012725856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012725856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012725857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012725857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012725858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012725858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012725858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:27.352886 run osmo-stp_10.42.42.5(pid=6850): stdout: | (launched: 2022-12-09_01:27:25.662057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:27.482288 run osmo-stp_10.42.42.5(pid=6850): stderr: | 20221209012725856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012725856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012725857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012725857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012725858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012725858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012725858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:27.638075 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6850): Process ended prematurely: osmo-stp_10.42.42.5(pid=6850) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6850)] [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:27:27.647950 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:27:27.676409 run osmo-hlr_10.42.42.2(pid=6847): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6847)] 01:27:27.726956 run osmo-hlr_10.42.42.2(pid=6847): stdout: | (launched: 2022-12-09_01:27:24.655414) 01:27:27.779608 run osmo-hlr_10.42.42.2(pid=6847): stderr: | 20221209012724858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012724858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012724858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012724858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012724858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012724858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012724870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012724879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012724879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012724879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:27.852326 run osmo-msc_10.42.42.6(pid=6853): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6853)] 01:27:27.902547 run osmo-msc_10.42.42.6(pid=6853): stdout: | (launched: 2022-12-09_01:27:26.702060) 01:27:27.954424 run osmo-msc_10.42.42.6(pid=6853): stderr: | 20221209012727025 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012727025 DLGLOBAL DEBUG validating counter group 0x7f18a1649c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012727025 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012727025 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012727025 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012727025 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012727027 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012727027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012727027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012727028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:28.006687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6846): Terminating (SIGTERM) 01:27:28.048723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6849): Terminating (SIGTERM) 01:27:28.090637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6852): Terminating (SIGTERM) 01:27:28.132892 --- ParallelTerminationStrategy: PID 6846 died... 01:27:28.153208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6846): Terminated: ok {rc=0} 01:27:28.199623 --- ParallelTerminationStrategy: PID 6849 died... 01:27:28.219285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6849): Terminated: ok {rc=0} 01:27:28.265626 --- ParallelTerminationStrategy: PID 6852 died... 01:27:28.285434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6852): Terminated: ok {rc=0} 01:27:28.372760 bus /sierra_3: Setting Powered False 01:27:29.471612 bus /sierra_3: Setting Powered False 01:27:30.584463 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:27:31.843203 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:27:31.852297 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:27:31.894854 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:27:31.927096 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:27:31.989021 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:27:32.024296 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:27:32.054020 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:27:32.598804 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:27:32.647652 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:32.658649 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:27:32.726775 tst mo_mt_call.py: using LAC 18114 01:27:32.845649 tst mo_mt_call.py: using RAC 9 01:27:32.974807 tst mo_mt_call.py: using CellId 18114 01:27:33.108702 tst mo_mt_call.py: using BVCI 18115 01:27:33.228221 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:33.239895 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:33.251313 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:33.263524 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:33.275355 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:33.287113 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:27:33.405702 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:27:33.523579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:33.990367 run create_hlr_db(pid=6859): Launched 01:27:34.108621 bus /sierra_2: Setting Powered False 01:27:35.168761 run create_hlr_db(pid=6859): Terminated: ok {rc=0} 01:27:35.611897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6861): Launched 01:27:35.929285 run osmo-hlr_10.42.42.2(pid=6863): Launched 01:27:36.046951 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:36.582463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6865): Launched 01:27:36.887066 run osmo-stp_10.42.42.5(pid=6866): Launched 01:27:37.002709 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:37.551860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6868): Launched 01:27:37.854325 run osmo-msc_10.42.42.6(pid=6869): Launched 01:27:38.024177 run osmo-stp_10.42.42.5(pid=6866): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6866)] 01:27:38.152846 run osmo-stp_10.42.42.5(pid=6866): stdout: | (launched: 2022-12-09_01:27:36.832037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:38.281254 run osmo-stp_10.42.42.5(pid=6866): stderr: | 20221209012736999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012737000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012737000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012737000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012737001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012737001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012737001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:38.407255 run osmo-stp_10.42.42.5(pid=6866): stdout: | (launched: 2022-12-09_01:27:36.832037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:38.527621 run osmo-stp_10.42.42.5(pid=6866): stderr: | 20221209012736999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012737000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012737000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012737000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012737001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012737001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012737001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:38.671814 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6866): Process ended prematurely: osmo-stp_10.42.42.5(pid=6866) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6866)] [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:27:38.680747 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:27:38.707750 run osmo-hlr_10.42.42.2(pid=6863): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6863)] 01:27:38.756100 run osmo-hlr_10.42.42.2(pid=6863): stdout: | (launched: 2022-12-09_01:27:35.873799) 01:27:38.806491 run osmo-hlr_10.42.42.2(pid=6863): stderr: | 20221209012736052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012736052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012736052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012736052 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012736052 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012736052 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012736064 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012736073 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012736073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012736073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:38.876132 run osmo-msc_10.42.42.6(pid=6869): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6869)] 01:27:38.924570 run osmo-msc_10.42.42.6(pid=6869): stdout: | (launched: 2022-12-09_01:27:37.799146) 01:27:38.974673 run osmo-msc_10.42.42.6(pid=6869): stderr: | 20221209012738070 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012738070 DLGLOBAL DEBUG validating counter group 0x7f01fabb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012738070 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012738070 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012738070 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012738071 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012738072 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012738073 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012738073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012738073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:39.025088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6861): Terminating (SIGTERM) 01:27:39.064858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6865): Terminating (SIGTERM) 01:27:39.104654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6868): Terminating (SIGTERM) 01:27:39.145161 --- ParallelTerminationStrategy: PID 6861 died... 01:27:39.164537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6861): Terminated: ok {rc=0} 01:27:39.208801 --- ParallelTerminationStrategy: PID 6865 died... 01:27:39.227357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6865): Terminated: ok {rc=0} 01:27:39.272234 --- ParallelTerminationStrategy: PID 6868 died... 01:27:39.290734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6868): Terminated: ok {rc=0} 01:27:39.376628 bus /sierra_3: Setting Powered False 01:27:40.477188 bus /sierra_3: Setting Powered False 01:27:41.588856 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:27:42.737791 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:42.750191 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:27:42.822553 tst mo_mt_call_osmux.py: using LAC 18115 01:27:42.951586 tst mo_mt_call_osmux.py: using RAC 10 01:27:43.075913 tst mo_mt_call_osmux.py: using CellId 18115 01:27:43.194584 tst mo_mt_call_osmux.py: using BVCI 18116 01:27:43.306214 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:43.317318 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:43.328062 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:43.339134 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:43.350208 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:43.361425 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:27:43.481705 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:27:43.597822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:44.065853 run create_hlr_db(pid=6871): Launched 01:27:44.182499 bus /sierra_2: Setting Powered False 01:27:45.243208 run create_hlr_db(pid=6871): Terminated: ok {rc=0} 01:27:45.667142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6873): Launched 01:27:46.001718 run osmo-hlr_10.42.42.2(pid=6874): Launched 01:27:46.246913 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:46.940628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6876): Launched 01:27:47.261879 run osmo-stp_10.42.42.5(pid=6877): Launched 01:27:47.378822 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:47.927518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6879): Launched 01:27:48.231014 run osmo-msc_10.42.42.6(pid=6880): Launched 01:27:48.400510 run osmo-stp_10.42.42.5(pid=6877): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6877)] 01:27:48.529353 run osmo-stp_10.42.42.5(pid=6877): stdout: | (launched: 2022-12-09_01:27:47.206034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:48.658123 run osmo-stp_10.42.42.5(pid=6877): stderr: | 20221209012747375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012747375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012747376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012747376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012747376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012747377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012747377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:48.784620 run osmo-stp_10.42.42.5(pid=6877): stdout: | (launched: 2022-12-09_01:27:47.206034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:48.905781 run osmo-stp_10.42.42.5(pid=6877): stderr: | 20221209012747375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012747375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012747376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012747376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012747376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012747377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012747377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:49.049949 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6877): Process ended prematurely: osmo-stp_10.42.42.5(pid=6877) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6877)] [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:27:49.059011 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 01:27:49.086342 run osmo-hlr_10.42.42.2(pid=6874): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6874)] 01:27:49.134925 run osmo-hlr_10.42.42.2(pid=6874): stdout: | (launched: 2022-12-09_01:27:45.937701) 01:27:49.184918 run osmo-hlr_10.42.42.2(pid=6874): stderr: | 20221209012746283 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012746283 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012746283 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012746283 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012746283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012746283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012746303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012746316 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012746316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012746316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:49.254490 run osmo-msc_10.42.42.6(pid=6880): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6880)] 01:27:49.302877 run osmo-msc_10.42.42.6(pid=6880): stdout: | (launched: 2022-12-09_01:27:48.175356) 01:27:49.352846 run osmo-msc_10.42.42.6(pid=6880): stderr: | 20221209012748446 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012748447 DLGLOBAL DEBUG validating counter group 0x7f68b488fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012748447 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012748447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012748447 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012748447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012748450 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012748451 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012748452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012748452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:49.402999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6873): Terminating (SIGTERM) 01:27:49.443173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6876): Terminating (SIGTERM) 01:27:49.483444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6879): Terminating (SIGTERM) 01:27:49.523957 --- ParallelTerminationStrategy: PID 6873 died... 01:27:49.543305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6873): Terminated: ok {rc=0} 01:27:49.588233 --- ParallelTerminationStrategy: PID 6876 died... 01:27:49.607146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6876): Terminated: ok {rc=0} 01:27:49.651741 --- ParallelTerminationStrategy: PID 6879 died... 01:27:49.670582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6879): Terminated: ok {rc=0} 01:27:49.755470 bus /sierra_3: Setting Powered False 01:27:50.852023 bus /sierra_3: Setting Powered False 01:27:51.968727 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:27:53.219807 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:27:53.226177 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:27:53.259735 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:27:53.286158 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:27:53.339155 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:27:53.372355 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:27:53.398936 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:27:53.947832 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:27:53.996935 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:54.008117 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:27:54.077449 tst mo_mt_call.py: using LAC 18116 01:27:54.204931 tst mo_mt_call.py: using RAC 11 01:27:54.331886 tst mo_mt_call.py: using CellId 18116 01:27:54.458843 tst mo_mt_call.py: using BVCI 18117 01:27:54.578355 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:54.590377 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:54.602133 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:54.613667 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:54.625170 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:54.636541 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:27:54.750765 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:27:54.870760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:55.373336 run create_hlr_db(pid=6885): Launched 01:27:55.506331 bus /sierra_2: Setting Powered False 01:27:56.570966 run create_hlr_db(pid=6885): Terminated: ok {rc=0} 01:27:57.022793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6887): Launched 01:27:57.347465 run osmo-hlr_10.42.42.2(pid=6888): Launched 01:27:57.471189 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:58.034063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6890): Launched 01:27:58.360538 run osmo-stp_10.42.42.5(pid=6891): Launched 01:27:58.484490 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:59.072752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6893): Launched 01:27:59.398776 run osmo-msc_10.42.42.6(pid=6894): Launched 01:27:59.581392 run osmo-stp_10.42.42.5(pid=6891): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6891)] 01:27:59.718992 run osmo-stp_10.42.42.5(pid=6891): stdout: | (launched: 2022-12-09_01:27:58.301446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:59.857076 run osmo-stp_10.42.42.5(pid=6891): stderr: | 20221209012758495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012758495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012758496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012758496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012758497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012758497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012758497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:59.993994 run osmo-stp_10.42.42.5(pid=6891): stdout: | (launched: 2022-12-09_01:27:58.301446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:00.123835 run osmo-stp_10.42.42.5(pid=6891): stderr: | 20221209012758495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012758495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012758496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012758496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012758497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012758497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012758497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:00.279427 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6891): Process ended prematurely: osmo-stp_10.42.42.5(pid=6891) [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6891)] [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:28:00.289185 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:28:00.317520 run osmo-hlr_10.42.42.2(pid=6888): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6888)] 01:28:00.368724 run osmo-hlr_10.42.42.2(pid=6888): stdout: | (launched: 2022-12-09_01:27:57.288907) 01:28:00.421693 run osmo-hlr_10.42.42.2(pid=6888): stderr: | 20221209012757488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012757488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012757488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012757489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012757489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012757489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012757501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012757509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012757509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012757509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:00.495486 run osmo-msc_10.42.42.6(pid=6894): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6894)] 01:28:00.546857 run osmo-msc_10.42.42.6(pid=6894): stdout: | (launched: 2022-12-09_01:27:59.339666) 01:28:00.599623 run osmo-msc_10.42.42.6(pid=6894): stderr: | 20221209012759664 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012759665 DLGLOBAL DEBUG validating counter group 0x7fbd07f05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012759665 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012759665 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012759665 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012759666 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012759667 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012759668 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012759668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012759668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:00.652422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6887): Terminating (SIGTERM) 01:28:00.694629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6890): Terminating (SIGTERM) 01:28:00.737077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6893): Terminating (SIGTERM) 01:28:00.779583 --- ParallelTerminationStrategy: PID 6887 died... 01:28:00.800092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6887): Terminated: ok {rc=0} 01:28:00.862768 --- ParallelTerminationStrategy: PID 6890 died... 01:28:00.888803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6890): Terminated: ok {rc=0} 01:28:00.942142 --- ParallelTerminationStrategy: PID 6893 died... 01:28:00.962035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6893): Terminated: ok {rc=0} 01:28:01.051988 bus /sierra_3: Setting Powered False 01:28:02.157111 bus /sierra_3: Setting Powered False 01:28:03.275162 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:28:04.427181 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:28:04.439610 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:28:04.512299 tst mo_mt_call_osmux.py: using LAC 18117 01:28:04.639622 tst mo_mt_call_osmux.py: using RAC 12 01:28:04.770297 tst mo_mt_call_osmux.py: using CellId 18117 01:28:04.897054 tst mo_mt_call_osmux.py: using BVCI 18118 01:28:05.014580 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:28:05.026656 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:28:05.038245 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:28:05.049942 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:28:05.061995 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:28:05.074125 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:28:05.192681 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:28:05.312234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:05.814640 run create_hlr_db(pid=6896): Launched 01:28:05.948151 bus /sierra_2: Setting Powered False 01:28:07.012905 run create_hlr_db(pid=6896): Terminated: ok {rc=0} 01:28:07.464818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6898): Launched 01:28:07.790073 run osmo-hlr_10.42.42.2(pid=6899): Launched 01:28:07.915115 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:08.478659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6901): Launched 01:28:08.803819 run osmo-stp_10.42.42.5(pid=6902): Launched 01:28:08.927306 run osmo-msc_10.42.42.6: Starting osmo-msc 01:28:09.520593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6904): Launched 01:28:09.845747 run osmo-msc_10.42.42.6(pid=6905): Launched 01:28:10.027146 run osmo-stp_10.42.42.5(pid=6902): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6902)] 01:28:10.163770 run osmo-stp_10.42.42.5(pid=6902): stdout: | (launched: 2022-12-09_01:28:08.744737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:10.301101 run osmo-stp_10.42.42.5(pid=6902): stderr: | 20221209012808937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012808937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012808938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012808938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012808940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012808940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012808941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:10.437397 run osmo-stp_10.42.42.5(pid=6902): stdout: | (launched: 2022-12-09_01:28:08.744737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:10.566898 run osmo-stp_10.42.42.5(pid=6902): stderr: | 20221209012808937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012808937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012808938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012808938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012808940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012808940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012808941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:10.721469 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6902): Process ended prematurely: osmo-stp_10.42.42.5(pid=6902) [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6902)] [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:28:10.730946 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:28:10.759145 run osmo-hlr_10.42.42.2(pid=6899): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6899)] 01:28:10.809751 run osmo-hlr_10.42.42.2(pid=6899): stdout: | (launched: 2022-12-09_01:28:07.731298) 01:28:10.861874 run osmo-hlr_10.42.42.2(pid=6899): stderr: | 20221209012807929 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012807929 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012807929 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012807930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012807930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012807930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012807942 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012807950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012807950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012807950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:10.934462 run osmo-msc_10.42.42.6(pid=6905): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6905)] 01:28:10.984684 run osmo-msc_10.42.42.6(pid=6905): stdout: | (launched: 2022-12-09_01:28:09.786981) 01:28:11.036597 run osmo-msc_10.42.42.6(pid=6905): stderr: | 20221209012810113 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012810113 DLGLOBAL DEBUG validating counter group 0x7fded8c73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012810114 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012810114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012810114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012810114 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012810117 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012810118 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012810118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012810118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:11.089777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6898): Terminating (SIGTERM) 01:28:11.131231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6901): Terminating (SIGTERM) 01:28:11.172883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6904): Terminating (SIGTERM) 01:28:11.214777 --- ParallelTerminationStrategy: PID 6898 died... 01:28:11.234758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6898): Terminated: ok {rc=0} 01:28:11.281133 --- ParallelTerminationStrategy: PID 6901 died... 01:28:11.300784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6901): Terminated: ok {rc=0} 01:28:11.347013 --- ParallelTerminationStrategy: PID 6904 died... 01:28:11.366652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6904): Terminated: ok {rc=0} 01:28:11.454627 bus /sierra_3: Setting Powered False 01:28:12.554701 bus /sierra_3: Setting Powered False 01:28:13.671411 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:28:14.924528 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:28:14.930729 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:28:14.964289 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:28:14.991291 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:28:15.043542 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:28:15.077121 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:28:15.104668 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:28:15.656912 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:28:15.707602 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:15.718732 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:28:15.786169 tst mo_mt_call.py: using LAC 18118 01:28:15.939249 tst mo_mt_call.py: using RAC 13 01:28:16.073467 tst mo_mt_call.py: using CellId 18118 01:28:16.207342 tst mo_mt_call.py: using BVCI 18119 01:28:16.330313 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:16.345390 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:16.356930 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:16.368424 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:16.380458 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:16.392120 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:28:16.509274 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:28:16.642915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:17.161329 run create_hlr_db(pid=6910): Launched 01:28:17.316073 bus /sierra_2: Setting Powered False 01:28:18.379867 run create_hlr_db(pid=6910): Terminated: ok {rc=0} 01:28:18.813868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6912): Launched 01:28:19.117394 run osmo-hlr_10.42.42.2(pid=6913): Launched 01:28:19.233891 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:19.767879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6915): Launched 01:28:20.071595 run osmo-stp_10.42.42.5(pid=6916): Launched 01:28:20.188483 run osmo-msc_10.42.42.6: Starting osmo-msc 01:28:20.738747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6918): Launched 01:28:21.045869 run osmo-msc_10.42.42.6(pid=6919): Launched 01:28:21.216039 run osmo-stp_10.42.42.5(pid=6916): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6916)] 01:28:21.344377 run osmo-stp_10.42.42.5(pid=6916): stdout: | (launched: 2022-12-09_01:28:20.016397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:21.473461 run osmo-stp_10.42.42.5(pid=6916): stderr: | 20221209012820184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012820184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012820185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012820185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012820187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012820187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012820187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:21.600191 run osmo-stp_10.42.42.5(pid=6916): stdout: | (launched: 2022-12-09_01:28:20.016397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:21.720556 run osmo-stp_10.42.42.5(pid=6916): stderr: | 20221209012820184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012820184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012820185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012820185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012820187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012820187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012820187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:21.864875 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6916): Process ended prematurely: osmo-stp_10.42.42.5(pid=6916) [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6916)] [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:28:21.873939 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:28:21.901733 run osmo-hlr_10.42.42.2(pid=6913): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6913)] 01:28:21.950244 run osmo-hlr_10.42.42.2(pid=6913): stdout: | (launched: 2022-12-09_01:28:19.062186) 01:28:22.000469 run osmo-hlr_10.42.42.2(pid=6913): stderr: | 20221209012819240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012819240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012819240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012819240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012819240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012819240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012819252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012819261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012819263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012819263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:22.070533 run osmo-msc_10.42.42.6(pid=6919): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6919)] 01:28:22.118665 run osmo-msc_10.42.42.6(pid=6919): stdout: | (launched: 2022-12-09_01:28:20.990150) 01:28:22.168486 run osmo-msc_10.42.42.6(pid=6919): stderr: | 20221209012821264 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012821265 DLGLOBAL DEBUG validating counter group 0x7f609175cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012821265 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012821265 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012821265 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012821265 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012821267 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012821268 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012821268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012821268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:22.218692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6912): Terminating (SIGTERM) 01:28:22.258690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6915): Terminating (SIGTERM) 01:28:22.298657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6918): Terminating (SIGTERM) 01:28:22.338925 --- ParallelTerminationStrategy: PID 6912 died... 01:28:22.358064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6912): Terminated: ok {rc=0} 01:28:22.402752 --- ParallelTerminationStrategy: PID 6915 died... 01:28:22.421453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6915): Terminated: ok {rc=0} 01:28:22.465619 --- ParallelTerminationStrategy: PID 6918 died... 01:28:22.484401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6918): Terminated: ok {rc=0} 01:28:22.570667 bus /sierra_3: Setting Powered False 01:28:23.670880 bus /sierra_3: Setting Powered False 01:28:24.787799 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:28:25.934322 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:25.946115 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:28:26.017338 tst mo_mt_call_osmux.py: using LAC 18119 01:28:26.137743 tst mo_mt_call_osmux.py: using RAC 14 01:28:26.256848 tst mo_mt_call_osmux.py: using CellId 18119 01:28:26.377412 tst mo_mt_call_osmux.py: using BVCI 18120 01:28:26.496429 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:26.508282 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:26.519559 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:26.530909 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:26.542086 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:26.553528 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:28:26.674488 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:28:26.796358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:27.303003 run create_hlr_db(pid=6921): Launched 01:28:27.435155 bus /sierra_2: Setting Powered False 01:28:28.499777 run create_hlr_db(pid=6921): Terminated: ok {rc=0} 01:28:28.933264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6923): Launched 01:28:29.236917 run osmo-hlr_10.42.42.2(pid=6924): Launched 01:28:29.352866 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:29.889519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6926): Launched 01:28:30.192877 run osmo-stp_10.42.42.5(pid=6927): Launched 01:28:30.308602 run osmo-msc_10.42.42.6: Starting osmo-msc 01:28:30.871327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6929): Launched 01:28:31.206837 run osmo-msc_10.42.42.6(pid=6930): Launched 01:28:31.498200 run osmo-stp_10.42.42.5(pid=6927): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6927)] 01:28:31.766589 run osmo-stp_10.42.42.5(pid=6927): stdout: | (launched: 2022-12-09_01:28:30.137515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:32.050815 run osmo-stp_10.42.42.5(pid=6927): stderr: | 20221209012830308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012830309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012830309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012830309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012830310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012830310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012830310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:32.181255 run osmo-stp_10.42.42.5(pid=6927): stdout: | (launched: 2022-12-09_01:28:30.137515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:32.306520 run osmo-stp_10.42.42.5(pid=6927): stderr: | 20221209012830308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012830309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012830309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012830309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012830310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012830310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012830310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:32.454236 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6927): Process ended prematurely: osmo-stp_10.42.42.5(pid=6927) [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6927)] [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:28:32.463761 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 01:28:32.491453 run osmo-hlr_10.42.42.2(pid=6924): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6924)] 01:28:32.540553 run osmo-hlr_10.42.42.2(pid=6924): stdout: | (launched: 2022-12-09_01:28:29.180506) 01:28:32.590961 run osmo-hlr_10.42.42.2(pid=6924): stderr: | 20221209012829357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012829357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012829357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012829357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012829357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012829357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012829369 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012829378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012829378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012829379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:32.660471 run osmo-msc_10.42.42.6(pid=6930): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6930)] 01:28:32.708924 run osmo-msc_10.42.42.6(pid=6930): stdout: | (launched: 2022-12-09_01:28:31.151391) 01:28:32.758783 run osmo-msc_10.42.42.6(pid=6930): stderr: | 20221209012831773 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012831774 DLGLOBAL DEBUG validating counter group 0x7fd3ccd93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012831774 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012831774 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012831774 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012831774 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012831776 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012831776 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012831776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012831776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:32.809247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6923): Terminating (SIGTERM) 01:28:32.849767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6926): Terminating (SIGTERM) 01:28:32.889907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6929): Terminating (SIGTERM) 01:28:32.930237 --- ParallelTerminationStrategy: PID 6923 died... 01:28:32.949631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6923): Terminated: ok {rc=0} 01:28:32.994483 --- ParallelTerminationStrategy: PID 6926 died... 01:28:33.013531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6926): Terminated: ok {rc=0} 01:28:33.058677 --- ParallelTerminationStrategy: PID 6929 died... 01:28:33.077813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6929): Terminated: ok {rc=0} 01:28:33.164297 bus /sierra_3: Setting Powered False 01:28:34.262106 bus /sierra_3: Setting Powered False 01:28:35.378752 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 emergency:trx-lms --------------------------------------------------------------------- 01:28:36.628039 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:28:36.632427 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 01:28:36.666162 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 01:28:36.693484 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 01:28:36.777765 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 01:28:36.810619 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 01:28:36.837173 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 01:28:37.417844 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2352 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 01:28:37.422810 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:37.433441 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 01:28:37.485447 tst emergency_mo_mt_call.py: using LAC 18120 01:28:37.602336 tst emergency_mo_mt_call.py: using RAC 15 01:28:37.723947 tst emergency_mo_mt_call.py: using CellId 18120 01:28:37.840874 tst emergency_mo_mt_call.py: using BVCI 18121 01:28:37.948707 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:37.959382 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:37.969772 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:37.980381 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:37.991113 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:38.001803 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:38.118898 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:38.240331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:38.735590 run create_hlr_db(pid=6935): Launched 01:28:38.866293 bus /sierra_2: Setting Powered False 01:28:39.929968 run create_hlr_db(pid=6935): Terminated: ok {rc=0} 01:28:40.356938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6937): Launched 01:28:40.656093 run osmo-hlr_10.42.42.2(pid=6938): Launched 01:28:40.770921 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:41.298890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6940): Launched 01:28:41.597113 run osmo-stp_10.42.42.5(pid=6941): Launched 01:28:41.721160 tst emergency_mo_mt_call.py: using MSISDN 6952 01:28:41.872023 run osmo-msc_10.42.42.6: Starting osmo-msc 01:28:42.407372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6943): Launched 01:28:42.705731 run osmo-msc_10.42.42.6(pid=6944): Launched 01:28:42.873145 run osmo-stp_10.42.42.5(pid=6941): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6941)] 01:28:42.999081 run osmo-stp_10.42.42.5(pid=6941): stdout: | (launched: 2022-12-09_01:28:41.542610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:43.125846 run osmo-stp_10.42.42.5(pid=6941): stderr: | 20221209012841713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012841713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012841713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012841714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012841714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012841714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012841715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:43.250452 run osmo-stp_10.42.42.5(pid=6941): stdout: | (launched: 2022-12-09_01:28:41.542610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:43.369941 run osmo-stp_10.42.42.5(pid=6941): stderr: | 20221209012841713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012841713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012841713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012841714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012841714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012841714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012841715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:43.511831 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6941): Process ended prematurely: osmo-stp_10.42.42.5(pid=6941) [trial-2352↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6941)] [trial-2352↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 01:28:43.520348 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 01:28:43.547145 run osmo-hlr_10.42.42.2(pid=6938): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6938)] 01:28:43.595673 run osmo-hlr_10.42.42.2(pid=6938): stdout: | (launched: 2022-12-09_01:28:40.601084) 01:28:43.645515 run osmo-hlr_10.42.42.2(pid=6938): stderr: | 20221209012840779 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012840779 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012840779 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012840779 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012840779 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012840779 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012840791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012840800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012840801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012840801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:43.714638 run osmo-msc_10.42.42.6(pid=6944): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6944)] 01:28:43.762777 run osmo-msc_10.42.42.6(pid=6944): stdout: | (launched: 2022-12-09_01:28:42.650441) 01:28:43.812298 run osmo-msc_10.42.42.6(pid=6944): stderr: | 20221209012842922 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012842922 DLGLOBAL DEBUG validating counter group 0x7f2ab3baac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012842922 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012842922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012842922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012842923 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012842925 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012842925 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012842925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012842926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:43.862299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6937): Terminating (SIGTERM) 01:28:43.902193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6940): Terminating (SIGTERM) 01:28:43.942312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6943): Terminating (SIGTERM) 01:28:43.982888 --- ParallelTerminationStrategy: PID 6937 died... 01:28:44.002087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6937): Terminated: ok {rc=0} 01:28:44.047471 --- ParallelTerminationStrategy: PID 6940 died... 01:28:44.066352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6940): Terminated: ok {rc=0} 01:28:44.111150 --- ParallelTerminationStrategy: PID 6943 died... 01:28:44.129868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6943): Terminated: ok {rc=0} 01:28:44.214539 bus /sierra_3: Setting Powered False 01:28:45.310681 bus /sierra_3: Setting Powered False 01:28:46.431742 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 01:28:47.521256 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:47.532599 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 01:28:47.585436 tst emergency_preemptive_call.py: using LAC 18121 01:28:47.702341 tst emergency_preemptive_call.py: using RAC 16 01:28:47.821363 tst emergency_preemptive_call.py: using CellId 18121 01:28:47.937599 tst emergency_preemptive_call.py: using BVCI 18122 01:28:48.045582 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:48.056217 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:48.066724 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:48.077465 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:48.088141 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:48.098796 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:48.215710 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:48.331192 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:48.447648 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:48.562895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:49.024678 run create_hlr_db(pid=6946): Launched 01:28:49.139629 bus /sierra_2: Setting Powered False 01:28:50.200171 run create_hlr_db(pid=6946): Terminated: ok {rc=0} 01:28:50.638788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6948): Launched 01:28:50.959191 run osmo-hlr_10.42.42.2(pid=6949): Launched 01:28:51.081667 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:51.633982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6951): Launched 01:28:51.954317 run osmo-stp_10.42.42.5(pid=6952): Launched 01:28:52.086318 tst emergency_preemptive_call.py: using MSISDN 6953 01:28:52.249134 run osmo-msc_10.42.42.6: Starting osmo-msc 01:28:52.822196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6954): Launched 01:28:53.140290 run osmo-msc_10.42.42.6(pid=6955): Launched 01:28:53.319770 run osmo-stp_10.42.42.5(pid=6952): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6952)] 01:28:53.454610 run osmo-stp_10.42.42.5(pid=6952): stdout: | (launched: 2022-12-09_01:28:51.895824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:53.590094 run osmo-stp_10.42.42.5(pid=6952): stderr: | 20221209012852090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012852090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012852090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012852091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012852091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012852091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012852091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:53.724024 run osmo-stp_10.42.42.5(pid=6952): stdout: | (launched: 2022-12-09_01:28:51.895824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:53.851005 run osmo-stp_10.42.42.5(pid=6952): stderr: | 20221209012852090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012852090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012852090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012852091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012852091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012852091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012852091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:54.002473 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6952): Process ended prematurely: osmo-stp_10.42.42.5(pid=6952) [trial-2352↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6952)] [trial-2352↪emergency:trx-lms↪emergency_preemptive_call.py:32] 01:28:54.011503 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 01:28:54.039080 run osmo-hlr_10.42.42.2(pid=6949): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6949)] 01:28:54.089658 run osmo-hlr_10.42.42.2(pid=6949): stdout: | (launched: 2022-12-09_01:28:50.900631) 01:28:54.141498 run osmo-hlr_10.42.42.2(pid=6949): stderr: | 20221209012851098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012851098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012851098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012851098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012851098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012851098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012851110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012851119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012851119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012851119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:54.213779 run osmo-msc_10.42.42.6(pid=6955): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6955)] 01:28:54.263857 run osmo-msc_10.42.42.6(pid=6955): stdout: | (launched: 2022-12-09_01:28:53.082295) 01:28:54.315743 run osmo-msc_10.42.42.6(pid=6955): stderr: | 20221209012853404 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209012853404 DLGLOBAL DEBUG validating counter group 0x7f7d0944fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209012853404 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209012853404 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209012853404 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209012853404 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209012853406 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209012853407 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209012853407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209012853407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:54.367811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6948): Terminating (SIGTERM) 01:28:54.409435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6951): Terminating (SIGTERM) 01:28:54.451159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6954): Terminating (SIGTERM) 01:28:54.493125 --- ParallelTerminationStrategy: PID 6948 died... 01:28:54.512776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6948): Terminated: ok {rc=0} 01:28:54.559049 --- ParallelTerminationStrategy: PID 6951 died... 01:28:54.579054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6951): Terminated: ok {rc=0} 01:28:54.625514 --- ParallelTerminationStrategy: PID 6954 died... 01:28:54.645219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6954): Terminated: ok {rc=0} 01:28:54.732744 bus /sierra_9: Setting Powered False 01:28:55.830813 bus /sierra_9: Setting Powered False 01:28:56.948243 bus /sierra_8: Setting Powered False 01:28:58.046426 bus /sierra_8: Setting Powered False 01:28:59.162862 bus /sierra_3: Setting Powered False 01:29:00.260056 bus /sierra_3: Setting Powered False 01:29:01.377247 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-lms --------------------------------------------------------------------- 01:29:02.656702 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:29:02.661109 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 01:29:02.694226 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 01:29:02.732266 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 01:29:02.818319 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 01:29:02.851521 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 01:29:02.889968 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 01:29:03.482119 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 01:29:03.534286 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:03.544674 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:29:03.594148 tst cs_paging_gprs_active.py: using LAC 18122 01:29:03.711581 tst cs_paging_gprs_active.py: using RAC 17 01:29:03.829284 tst cs_paging_gprs_active.py: using CellId 18122 01:29:03.945954 tst cs_paging_gprs_active.py: using BVCI 18123 01:29:04.058352 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.068855 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.079235 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.089854 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.100273 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.110818 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.121519 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.131928 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.142614 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:04.261540 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:04.378268 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:29:04.582986 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:04.887444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6962): Launched 01:29:05.152204 run iperf3-srv_10.42.42.10(pid=6963): Launched 01:29:05.266478 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:29:05.468576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:05.773188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6964): Launched 01:29:06.038035 run iperf3-srv_10.42.42.10(pid=6965): Launched 01:29:06.154243 tst cs_paging_gprs_active.py:38: start network... 01:29:06.357345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:06.827422 run create_hlr_db(pid=6966): Launched 01:29:06.943873 bus /sierra_2: Setting Powered False 01:29:08.005294 run create_hlr_db(pid=6966): Terminated: ok {rc=0} 01:29:08.449802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6968): Launched 01:29:08.777401 run osmo-hlr_10.42.42.2(pid=6969): Launched 01:29:08.904141 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:09.465931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6971): Launched 01:29:09.794210 run osmo-stp_10.42.42.5(pid=6972): Launched 01:29:09.919048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:10.481365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6974): Launched 01:29:10.607649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:10.883927 run patchelf(pid=6975): Launched 01:29:11.066073 run osmo-stp_10.42.42.5(pid=6972): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6972)] 01:29:11.203991 run osmo-stp_10.42.42.5(pid=6972): stdout: | (launched: 2022-12-09_01:29:09.735265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:11.344610 run osmo-stp_10.42.42.5(pid=6972): stderr: | 20221209012909929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012909929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012909929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012909930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012909930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012909930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012909930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:11.484472 run osmo-stp_10.42.42.5(pid=6972): stdout: | (launched: 2022-12-09_01:29:09.735265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:11.619199 run osmo-stp_10.42.42.5(pid=6972): stderr: | 20221209012909929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012909929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012909929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012909930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012909930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012909930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012909930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:11.777581 run patchelf(pid=6975): Terminating (SIGINT) 01:29:11.960354 run patchelf(pid=6975): Terminated: ok {rc=0} 01:29:12.092409 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6972): Process ended prematurely: osmo-stp_10.42.42.5(pid=6972) [trial-2352↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6972)] [trial-2352↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 01:29:12.102629 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 01:29:12.131341 run osmo-hlr_10.42.42.2(pid=6969): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6969)] 01:29:12.181816 run osmo-hlr_10.42.42.2(pid=6969): stdout: | (launched: 2022-12-09_01:29:08.718186) 01:29:12.233927 run osmo-hlr_10.42.42.2(pid=6969): stderr: | 20221209012908918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012908918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012908918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012908918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012908918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012908918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012908930 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012908938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012908939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012908939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:12.286282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6962): Terminating (SIGTERM) 01:29:12.329446 run iperf3-srv_10.42.42.10(pid=6963): Terminating (SIGTERM) 01:29:12.373268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6964): Terminating (SIGTERM) 01:29:12.414353 run iperf3-srv_10.42.42.10(pid=6965): Terminating (SIGTERM) 01:29:12.455162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6968): Terminating (SIGTERM) 01:29:12.495909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6971): Terminating (SIGTERM) 01:29:12.536588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6974): Terminating (SIGTERM) 01:29:12.577392 --- ParallelTerminationStrategy: PID 6962 died... 01:29:12.597199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6962): Terminated: ok {rc=0} 01:29:12.643105 --- ParallelTerminationStrategy: PID 6963 died... 01:29:12.661873 run iperf3-srv_10.42.42.10(pid=6963): Terminated {rc=256} 01:29:12.707140 --- ParallelTerminationStrategy: PID 6964 died... 01:29:12.725603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6964): Terminated: ok {rc=0} 01:29:12.770709 --- ParallelTerminationStrategy: PID 6965 died... 01:29:12.789422 run iperf3-srv_10.42.42.10(pid=6965): Terminated {rc=256} 01:29:12.834601 --- ParallelTerminationStrategy: PID 6968 died... 01:29:12.853548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6968): Terminated: ok {rc=0} 01:29:12.898622 --- ParallelTerminationStrategy: PID 6971 died... 01:29:12.917177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6971): Terminated: ok {rc=0} 01:29:12.962426 --- ParallelTerminationStrategy: PID 6974 died... 01:29:12.981073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6974): Terminated: ok {rc=0} 01:29:13.068585 bus /gobi_0: Setting Powered False 01:29:14.170507 bus /gobi_0: Setting Powered False 01:29:15.286834 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms iperf3.py ---------------------------------------------- 01:29:16.455422 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:16.467993 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:29:16.531845 tst iperf3.py: using LAC 18123 01:29:16.658659 tst iperf3.py: using RAC 18 01:29:16.819404 tst iperf3.py: using CellId 18123 01:29:16.943772 tst iperf3.py: using BVCI 18124 01:29:17.057799 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:17.071869 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:17.086223 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:17.100447 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:17.115135 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:17.129705 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:17.144885 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:17.159890 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:17.173408 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:17.291857 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:29:17.499359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:17.806033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6977): Launched 01:29:18.075222 run iperf3-srv_10.42.42.10(pid=6978): Launched 01:29:18.189968 tst iperf3.py:8: start network... 01:29:18.394300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:18.865609 run create_hlr_db(pid=6979): Launched 01:29:18.982970 bus /gobi_6: Setting Powered False 01:29:20.043152 run create_hlr_db(pid=6979): Terminated: ok {rc=0} 01:29:20.487167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6981): Launched 01:29:20.816292 run osmo-hlr_10.42.42.2(pid=6982): Launched 01:29:20.941527 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:21.506082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6984): Launched 01:29:21.833101 run osmo-stp_10.42.42.5(pid=6985): Launched 01:29:21.957579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:22.517780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6987): Launched 01:29:22.642874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:22.916708 run patchelf(pid=6988): Launched 01:29:23.097884 run osmo-stp_10.42.42.5(pid=6985): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6985)] 01:29:23.236205 run osmo-stp_10.42.42.5(pid=6985): stdout: | (launched: 2022-12-09_01:29:21.774097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:23.375885 run osmo-stp_10.42.42.5(pid=6985): stderr: | 20221209012921968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012921968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012921968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012921968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012921969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012921969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012921969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:23.516123 run osmo-stp_10.42.42.5(pid=6985): stdout: | (launched: 2022-12-09_01:29:21.774097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:23.650832 run osmo-stp_10.42.42.5(pid=6985): stderr: | 20221209012921968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012921968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012921968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012921968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012921969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012921969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012921969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:23.808423 run patchelf(pid=6988): Terminating (SIGINT) 01:29:23.991304 run patchelf(pid=6988): Terminated: ok {rc=0} 01:29:24.123198 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6985): Process ended prematurely: osmo-stp_10.42.42.5(pid=6985) [trial-2352↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6985)] [trial-2352↪gprs:trx-lms↪iperf3.py:8] 01:29:24.133327 tst iperf3.py:8: Test FAILED (7.7 sec) 01:29:24.161849 run osmo-hlr_10.42.42.2(pid=6982): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6982)] 01:29:24.212324 run osmo-hlr_10.42.42.2(pid=6982): stdout: | (launched: 2022-12-09_01:29:20.757011) 01:29:24.264596 run osmo-hlr_10.42.42.2(pid=6982): stderr: | 20221209012920959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012920959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012920959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012920959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012920959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012920959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012920971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012920979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012920979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012920979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:24.317244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6977): Terminating (SIGTERM) 01:29:24.359500 run iperf3-srv_10.42.42.10(pid=6978): Terminating (SIGTERM) 01:29:24.401681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6981): Terminating (SIGTERM) 01:29:24.444023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6984): Terminating (SIGTERM) 01:29:24.486458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6987): Terminating (SIGTERM) 01:29:24.529149 --- ParallelTerminationStrategy: PID 6977 died... 01:29:24.549405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6977): Terminated: ok {rc=0} 01:29:24.596734 --- ParallelTerminationStrategy: PID 6978 died... 01:29:24.616626 run iperf3-srv_10.42.42.10(pid=6978): Terminated {rc=256} 01:29:24.663303 --- ParallelTerminationStrategy: PID 6981 died... 01:29:24.683152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6981): Terminated: ok {rc=0} 01:29:24.729587 --- ParallelTerminationStrategy: PID 6984 died... 01:29:24.749454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6984): Terminated: ok {rc=0} 01:29:24.795982 --- ParallelTerminationStrategy: PID 6987 died... 01:29:24.815880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6987): Terminated: ok {rc=0} 01:29:24.904121 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms iperf3m4.py ---------------------------------------------- 01:29:26.051007 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:26.062674 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:29:26.114258 tst iperf3m4.py: using LAC 18124 01:29:26.232778 tst iperf3m4.py: using RAC 19 01:29:26.350139 tst iperf3m4.py: using CellId 18124 01:29:26.467250 tst iperf3m4.py: using BVCI 18125 01:29:26.577845 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:26.588644 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:26.599098 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:26.609889 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:26.620386 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:26.630979 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:26.641803 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:26.652446 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:26.663293 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:26.777777 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:26.904064 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:27.021890 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:27.142568 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:29:27.362277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:27.689398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6989): Launched 01:29:27.973699 run iperf3-srv_10.42.42.10(pid=6990): Launched 01:29:28.098059 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:29:28.318282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:28.645951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6991): Launched 01:29:28.929906 run iperf3-srv_10.42.42.10(pid=6992): Launched 01:29:29.053229 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:29:29.272268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:29.598723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6993): Launched 01:29:29.883200 run iperf3-srv_10.42.42.10(pid=6994): Launched 01:29:30.004775 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:29:30.223302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:30.549101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6995): Launched 01:29:30.837699 run iperf3-srv_10.42.42.10(pid=6996): Launched 01:29:30.982930 tst iperf3m4.py:8: start network... 01:29:31.193946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:31.690165 run create_hlr_db(pid=6997): Launched 01:29:31.838821 bus /gobi_6: Setting Powered False 01:29:32.898456 run create_hlr_db(pid=6997): Terminated: ok {rc=0} 01:29:33.343928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6999): Launched 01:29:33.669686 run osmo-hlr_10.42.42.2(pid=7000): Launched 01:29:33.795529 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:34.353909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7002): Launched 01:29:34.680328 run osmo-stp_10.42.42.5(pid=7003): Launched 01:29:34.803075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:35.360438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7005): Launched 01:29:35.484669 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:35.758900 run patchelf(pid=7006): Launched 01:29:35.940808 run osmo-stp_10.42.42.5(pid=7003): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7003)] 01:29:36.078427 run osmo-stp_10.42.42.5(pid=7003): stdout: | (launched: 2022-12-09_01:29:34.621344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:36.217557 run osmo-stp_10.42.42.5(pid=7003): stderr: | 20221209012934811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012934811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012934812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012934812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012934813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012934813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012934813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:36.356420 run osmo-stp_10.42.42.5(pid=7003): stdout: | (launched: 2022-12-09_01:29:34.621344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:36.489077 run osmo-stp_10.42.42.5(pid=7003): stderr: | 20221209012934811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012934811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012934812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012934812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012934813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012934813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012934813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:36.646614 run patchelf(pid=7006): Terminating (SIGINT) 01:29:36.828300 run patchelf(pid=7006): Terminated: ok {rc=0} 01:29:36.959163 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7003): Process ended prematurely: osmo-stp_10.42.42.5(pid=7003) [trial-2352↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7003)] [trial-2352↪gprs:trx-lms↪iperf3m4.py:8] 01:29:36.969403 tst iperf3m4.py:8: Test FAILED (11.0 sec) 01:29:36.998137 run osmo-hlr_10.42.42.2(pid=7000): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7000)] 01:29:37.047934 run osmo-hlr_10.42.42.2(pid=7000): stdout: | (launched: 2022-12-09_01:29:33.610091) 01:29:37.099818 run osmo-hlr_10.42.42.2(pid=7000): stderr: | 20221209012933808 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012933808 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012933808 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012933808 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012933808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012933808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012933819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012933828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012933828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012933828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:37.152187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6989): Terminating (SIGTERM) 01:29:37.193920 run iperf3-srv_10.42.42.10(pid=6990): Terminating (SIGTERM) 01:29:37.235580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6991): Terminating (SIGTERM) 01:29:37.277498 run iperf3-srv_10.42.42.10(pid=6992): Terminating (SIGTERM) 01:29:37.318996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6993): Terminating (SIGTERM) 01:29:37.360905 run iperf3-srv_10.42.42.10(pid=6994): Terminating (SIGTERM) 01:29:37.402911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6995): Terminating (SIGTERM) 01:29:37.444636 run iperf3-srv_10.42.42.10(pid=6996): Terminating (SIGTERM) 01:29:37.486399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6999): Terminating (SIGTERM) 01:29:37.528147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7002): Terminating (SIGTERM) 01:29:37.570039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7005): Terminating (SIGTERM) 01:29:37.612369 --- ParallelTerminationStrategy: PID 6989 died... 01:29:37.632496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6989): Terminated: ok {rc=0} 01:29:37.679074 --- ParallelTerminationStrategy: PID 6990 died... 01:29:37.698706 run iperf3-srv_10.42.42.10(pid=6990): Terminated {rc=256} 01:29:37.745027 --- ParallelTerminationStrategy: PID 6991 died... 01:29:37.764750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6991): Terminated: ok {rc=0} 01:29:37.811144 --- ParallelTerminationStrategy: PID 6992 died... 01:29:37.830930 run iperf3-srv_10.42.42.10(pid=6992): Terminated {rc=256} 01:29:37.877072 --- ParallelTerminationStrategy: PID 6993 died... 01:29:37.896718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6993): Terminated: ok {rc=0} 01:29:37.942832 --- ParallelTerminationStrategy: PID 6994 died... 01:29:37.962259 run iperf3-srv_10.42.42.10(pid=6994): Terminated {rc=256} 01:29:38.008036 --- ParallelTerminationStrategy: PID 6995 died... 01:29:38.027599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6995): Terminated: ok {rc=0} 01:29:38.073713 --- ParallelTerminationStrategy: PID 6996 died... 01:29:38.093346 run iperf3-srv_10.42.42.10(pid=6996): Terminated {rc=256} 01:29:38.139402 --- ParallelTerminationStrategy: PID 6999 died... 01:29:38.159136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6999): Terminated: ok {rc=0} 01:29:38.205332 --- ParallelTerminationStrategy: PID 7002 died... 01:29:38.224843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7002): Terminated: ok {rc=0} 01:29:38.271150 --- ParallelTerminationStrategy: PID 7005 died... 01:29:38.290924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7005): Terminated: ok {rc=0} 01:29:38.378504 bus /gobi_4: Setting Powered False 01:29:39.474530 bus /gobi_4: Setting Powered False 01:29:40.590428 bus /gobi_1: Setting Powered False 01:29:41.688927 bus /gobi_1: Setting Powered False 01:29:42.804108 bus /gobi_0: Setting Powered False 01:29:43.901242 bus /gobi_0: Setting Powered False 01:29:45.016616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms ping.py ---------------------------------------------- 01:29:46.124834 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:46.137503 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:29:46.188246 tst ping.py: using LAC 18125 01:29:46.339424 tst ping.py: using RAC 20 01:29:46.483336 tst ping.py: using CellId 18125 01:29:46.635962 tst ping.py: using BVCI 18126 01:29:46.756174 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:46.768003 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:46.779728 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:46.791786 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:46.803840 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:46.816101 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:46.828329 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:46.840494 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:46.960814 tst ping.py:19: start network... 01:29:47.181943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:47.678059 run create_hlr_db(pid=7008): Launched 01:29:47.808386 bus /gobi_6: Setting Powered False 01:29:48.871994 run create_hlr_db(pid=7008): Terminated: ok {rc=0} 01:29:49.316462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7010): Launched 01:29:49.635221 run osmo-hlr_10.42.42.2(pid=7011): Launched 01:29:49.758276 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:50.308932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7013): Launched 01:29:50.627836 run osmo-stp_10.42.42.5(pid=7014): Launched 01:29:50.748878 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:51.297698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7016): Launched 01:29:51.421259 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:51.691256 run patchelf(pid=7017): Launched 01:29:51.871160 run osmo-stp_10.42.42.5(pid=7014): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7014)] 01:29:52.007265 run osmo-stp_10.42.42.5(pid=7014): stdout: | (launched: 2022-12-09_01:29:50.569552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:52.144776 run osmo-stp_10.42.42.5(pid=7014): stderr: | 20221209012950764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012950764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012950764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012950765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012950765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012950765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012950765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:52.281889 run osmo-stp_10.42.42.5(pid=7014): stdout: | (launched: 2022-12-09_01:29:50.569552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:52.413166 run osmo-stp_10.42.42.5(pid=7014): stderr: | 20221209012950764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012950764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012950764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012950765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012950765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012950765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012950765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:52.568215 run patchelf(pid=7017): Terminating (SIGINT) 01:29:52.747531 run patchelf(pid=7017): Terminated: ok {rc=0} 01:29:52.876102 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7014): Process ended prematurely: osmo-stp_10.42.42.5(pid=7014) [trial-2352↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7014)] [trial-2352↪gprs:trx-lms↪ping.py:22] 01:29:52.885829 tst ping.py:22: Test FAILED (6.8 sec) 01:29:52.914301 run osmo-hlr_10.42.42.2(pid=7011): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7011)] 01:29:52.964807 run osmo-hlr_10.42.42.2(pid=7011): stdout: | (launched: 2022-12-09_01:29:49.576565) 01:29:53.017063 run osmo-hlr_10.42.42.2(pid=7011): stderr: | 20221209012949777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012949777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012949777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012949777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012949777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012949777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012949790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012949798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012949799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012949799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:53.069743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7010): Terminating (SIGTERM) 01:29:53.112095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7013): Terminating (SIGTERM) 01:29:53.154374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7016): Terminating (SIGTERM) 01:29:53.196718 --- ParallelTerminationStrategy: PID 7010 died... 01:29:53.217094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7010): Terminated: ok {rc=0} 01:29:53.264136 --- ParallelTerminationStrategy: PID 7013 died... 01:29:53.284007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7013): Terminated: ok {rc=0} 01:29:53.330640 --- ParallelTerminationStrategy: PID 7016 died... 01:29:53.350629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7016): Terminated: ok {rc=0} 01:29:53.438525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 01:29:54.526027 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:54.537601 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:29:54.593220 tst ping_idle_ping.py: using LAC 18126 01:29:54.719256 tst ping_idle_ping.py: using RAC 21 01:29:54.842592 tst ping_idle_ping.py: using CellId 18126 01:29:54.967396 tst ping_idle_ping.py: using BVCI 18127 01:29:55.082814 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:55.093853 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:55.104813 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:55.115830 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:55.126639 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:55.137505 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:55.148388 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:55.159339 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:55.275004 tst ping_idle_ping.py:24: start network... 01:29:55.491689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:55.987788 run create_hlr_db(pid=7018): Launched 01:29:56.117657 bus /gobi_6: Setting Powered False 01:29:57.181899 run create_hlr_db(pid=7018): Terminated: ok {rc=0} 01:29:57.626747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7020): Launched 01:29:57.948995 run osmo-hlr_10.42.42.2(pid=7021): Launched 01:29:58.071340 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:58.621500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7023): Launched 01:29:58.941967 run osmo-stp_10.42.42.5(pid=7024): Launched 01:29:59.063229 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:59.614530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7026): Launched 01:29:59.738725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:00.009303 run patchelf(pid=7027): Launched 01:30:00.188653 run osmo-stp_10.42.42.5(pid=7024): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7024)] 01:30:00.324410 run osmo-stp_10.42.42.5(pid=7024): stdout: | (launched: 2022-12-09_01:29:58.883220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:00.461840 run osmo-stp_10.42.42.5(pid=7024): stderr: | 20221209012959075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012959076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012959076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012959076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012959077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012959077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012959077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:00.599113 run osmo-stp_10.42.42.5(pid=7024): stdout: | (launched: 2022-12-09_01:29:58.883220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:00.730539 run osmo-stp_10.42.42.5(pid=7024): stderr: | 20221209012959075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209012959076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209012959076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209012959076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209012959077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209012959077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209012959077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:00.891327 run patchelf(pid=7027): Terminating (SIGINT) 01:30:01.075418 run patchelf(pid=7027): Terminated: ok {rc=0} 01:30:01.207756 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7024): Process ended prematurely: osmo-stp_10.42.42.5(pid=7024) [trial-2352↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7024)] [trial-2352↪gprs:trx-lms↪ping_idle_ping.py:27] 01:30:01.217980 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:30:01.247551 run osmo-hlr_10.42.42.2(pid=7021): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7021)] 01:30:01.298814 run osmo-hlr_10.42.42.2(pid=7021): stdout: | (launched: 2022-12-09_01:29:57.889906) 01:30:01.352186 run osmo-hlr_10.42.42.2(pid=7021): stderr: | 20221209012958090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209012958090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209012958090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209012958090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209012958090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209012958090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209012958136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209012958145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209012958145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209012958145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:01.405623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7020): Terminating (SIGTERM) 01:30:01.448694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7023): Terminating (SIGTERM) 01:30:01.492262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7026): Terminating (SIGTERM) 01:30:01.536903 --- ParallelTerminationStrategy: PID 7020 died... 01:30:01.557344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7020): Terminated: ok {rc=0} 01:30:01.605157 --- ParallelTerminationStrategy: PID 7023 died... 01:30:01.626059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7023): Terminated: ok {rc=0} 01:30:01.673786 --- ParallelTerminationStrategy: PID 7026 died... 01:30:01.694436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7026): Terminated: ok {rc=0} 01:30:01.785447 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 01:30:03.087052 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:30:03.092461 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:30:03.126311 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:30:03.164762 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:30:03.256622 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:30:03.291360 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:30:03.329692 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:30:03.913796 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:30:03.964198 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:03.975339 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:30:04.027082 tst cs_paging_gprs_active.py: using LAC 18127 01:30:04.147451 tst cs_paging_gprs_active.py: using RAC 22 01:30:04.275421 tst cs_paging_gprs_active.py: using CellId 18127 01:30:04.402231 tst cs_paging_gprs_active.py: using BVCI 18128 01:30:04.521453 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.532933 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.544251 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.555562 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.566590 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.577699 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.588867 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.599862 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.611394 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:04.728681 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:04.845098 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:30:05.051914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:05.359954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7034): Launched 01:30:05.627388 run iperf3-srv_10.42.42.10(pid=7035): Launched 01:30:05.742473 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:30:05.947097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:06.254124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7036): Launched 01:30:06.520898 run iperf3-srv_10.42.42.10(pid=7037): Launched 01:30:06.636092 tst cs_paging_gprs_active.py:38: start network... 01:30:06.840681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:07.312359 run create_hlr_db(pid=7038): Launched 01:30:07.429699 bus /gobi_6: Setting Powered False 01:30:08.490380 run create_hlr_db(pid=7038): Terminated: ok {rc=0} 01:30:08.935073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7040): Launched 01:30:09.262844 run osmo-hlr_10.42.42.2(pid=7041): Launched 01:30:09.388300 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:09.951055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7043): Launched 01:30:10.277932 run osmo-stp_10.42.42.5(pid=7044): Launched 01:30:10.404083 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:10.965666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7046): Launched 01:30:11.090862 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:11.366994 run patchelf(pid=7047): Launched 01:30:11.549851 run osmo-stp_10.42.42.5(pid=7044): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7044)] 01:30:11.688103 run osmo-stp_10.42.42.5(pid=7044): stdout: | (launched: 2022-12-09_01:30:10.219012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:11.827856 run osmo-stp_10.42.42.5(pid=7044): stderr: | 20221209013010410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013010410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013010410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013010411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013010411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013010411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013010411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:11.967925 run osmo-stp_10.42.42.5(pid=7044): stdout: | (launched: 2022-12-09_01:30:10.219012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:12.102037 run osmo-stp_10.42.42.5(pid=7044): stderr: | 20221209013010410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013010410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013010410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013010411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013010411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013010411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013010411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:12.259809 run patchelf(pid=7047): Terminating (SIGINT) 01:30:12.443038 run patchelf(pid=7047): Terminated: ok {rc=0} 01:30:12.574822 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7044): Process ended prematurely: osmo-stp_10.42.42.5(pid=7044) [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7044)] [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:30:12.585101 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:30:12.614211 run osmo-hlr_10.42.42.2(pid=7041): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7041)] 01:30:12.664634 run osmo-hlr_10.42.42.2(pid=7041): stdout: | (launched: 2022-12-09_01:30:09.203565) 01:30:12.716751 run osmo-hlr_10.42.42.2(pid=7041): stderr: | 20221209013009403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013009403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013009403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013009403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013009403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013009403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013009417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013009425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013009426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013009426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:12.769146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7034): Terminating (SIGTERM) 01:30:12.810912 run iperf3-srv_10.42.42.10(pid=7035): Terminating (SIGTERM) 01:30:12.852695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7036): Terminating (SIGTERM) 01:30:12.895056 run iperf3-srv_10.42.42.10(pid=7037): Terminating (SIGTERM) 01:30:12.937011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7040): Terminating (SIGTERM) 01:30:12.979020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7043): Terminating (SIGTERM) 01:30:13.021112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7046): Terminating (SIGTERM) 01:30:13.063227 --- ParallelTerminationStrategy: PID 7034 died... 01:30:13.083412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7034): Terminated: ok {rc=0} 01:30:13.130049 --- ParallelTerminationStrategy: PID 7035 died... 01:30:13.149687 run iperf3-srv_10.42.42.10(pid=7035): Terminated {rc=256} 01:30:13.195663 --- ParallelTerminationStrategy: PID 7036 died... 01:30:13.215384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7036): Terminated: ok {rc=0} 01:30:13.261363 --- ParallelTerminationStrategy: PID 7037 died... 01:30:13.281054 run iperf3-srv_10.42.42.10(pid=7037): Terminated {rc=256} 01:30:13.327227 --- ParallelTerminationStrategy: PID 7040 died... 01:30:13.346988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7040): Terminated: ok {rc=0} 01:30:13.393269 --- ParallelTerminationStrategy: PID 7043 died... 01:30:13.412652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7043): Terminated: ok {rc=0} 01:30:13.459650 --- ParallelTerminationStrategy: PID 7046 died... 01:30:13.479421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7046): Terminated: ok {rc=0} 01:30:13.566314 bus /gobi_0: Setting Powered False 01:30:14.667165 bus /gobi_0: Setting Powered False 01:30:15.784467 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:30:16.941252 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:16.954295 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:30:17.007819 tst iperf3.py: using LAC 18128 01:30:17.135166 tst iperf3.py: using RAC 23 01:30:17.258430 tst iperf3.py: using CellId 18128 01:30:17.380475 tst iperf3.py: using BVCI 18129 01:30:17.492026 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:17.503129 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:17.513796 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:17.524792 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:17.535817 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:17.546832 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:17.557849 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:17.569298 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:17.580333 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:17.695426 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:30:17.899201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:18.203676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7048): Launched 01:30:18.468860 run iperf3-srv_10.42.42.10(pid=7049): Launched 01:30:18.583664 tst iperf3.py:8: start network... 01:30:18.787564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:19.259346 run create_hlr_db(pid=7050): Launched 01:30:19.375267 bus /gobi_6: Setting Powered False 01:30:20.436185 run create_hlr_db(pid=7050): Terminated: ok {rc=0} 01:30:20.881540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7052): Launched 01:30:21.209265 run osmo-hlr_10.42.42.2(pid=7053): Launched 01:30:21.333867 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:21.898427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7055): Launched 01:30:22.226882 run osmo-stp_10.42.42.5(pid=7056): Launched 01:30:22.351234 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:22.913128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7058): Launched 01:30:23.037637 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:23.311226 run patchelf(pid=7059): Launched 01:30:23.493823 run osmo-stp_10.42.42.5(pid=7056): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7056)] 01:30:23.632205 run osmo-stp_10.42.42.5(pid=7056): stdout: | (launched: 2022-12-09_01:30:22.167194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:23.771633 run osmo-stp_10.42.42.5(pid=7056): stderr: | 20221209013022360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013022360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013022360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013022361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013022361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013022361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013022361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:23.911326 run osmo-stp_10.42.42.5(pid=7056): stdout: | (launched: 2022-12-09_01:30:22.167194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:24.044159 run osmo-stp_10.42.42.5(pid=7056): stderr: | 20221209013022360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013022360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013022360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013022361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013022361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013022361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013022361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:24.202665 run patchelf(pid=7059): Terminating (SIGINT) 01:30:24.384917 run patchelf(pid=7059): Terminated: ok {rc=0} 01:30:24.516439 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7056): Process ended prematurely: osmo-stp_10.42.42.5(pid=7056) [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7056)] [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 01:30:24.526715 tst iperf3.py:8: Test FAILED (7.6 sec) 01:30:24.555633 run osmo-hlr_10.42.42.2(pid=7053): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7053)] 01:30:24.606250 run osmo-hlr_10.42.42.2(pid=7053): stdout: | (launched: 2022-12-09_01:30:21.149870) 01:30:24.658945 run osmo-hlr_10.42.42.2(pid=7053): stderr: | 20221209013021347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013021347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013021347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013021347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013021347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013021347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013021361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013021370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013021371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013021371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:24.711726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7048): Terminating (SIGTERM) 01:30:24.753906 run iperf3-srv_10.42.42.10(pid=7049): Terminating (SIGTERM) 01:30:24.795968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7052): Terminating (SIGTERM) 01:30:24.838044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7055): Terminating (SIGTERM) 01:30:24.880320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7058): Terminating (SIGTERM) 01:30:24.922823 --- ParallelTerminationStrategy: PID 7048 died... 01:30:24.943606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7048): Terminated: ok {rc=0} 01:30:24.990475 --- ParallelTerminationStrategy: PID 7049 died... 01:30:25.010440 run iperf3-srv_10.42.42.10(pid=7049): Terminated {rc=256} 01:30:25.057094 --- ParallelTerminationStrategy: PID 7052 died... 01:30:25.076916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7052): Terminated: ok {rc=0} 01:30:25.123374 --- ParallelTerminationStrategy: PID 7055 died... 01:30:25.143072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7055): Terminated: ok {rc=0} 01:30:25.189569 --- ParallelTerminationStrategy: PID 7058 died... 01:30:25.209394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7058): Terminated: ok {rc=0} 01:30:25.297384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:30:26.448154 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:26.460163 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:30:26.514487 tst iperf3m4.py: using LAC 18129 01:30:26.645363 tst iperf3m4.py: using RAC 24 01:30:26.774318 tst iperf3m4.py: using CellId 18129 01:30:26.902883 tst iperf3m4.py: using BVCI 18130 01:30:27.021967 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.033707 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.044779 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.055915 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.066925 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.077948 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.089179 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.100188 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.111389 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:27.226750 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:27.344326 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:27.465568 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:27.581946 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:30:27.786177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:28.092257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7060): Launched 01:30:28.358925 run iperf3-srv_10.42.42.10(pid=7061): Launched 01:30:28.474291 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:30:28.678745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:28.983831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7062): Launched 01:30:29.248185 run iperf3-srv_10.42.42.10(pid=7063): Launched 01:30:29.363291 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:30:29.566941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:29.872484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7064): Launched 01:30:30.137705 run iperf3-srv_10.42.42.10(pid=7065): Launched 01:30:30.252884 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:30:30.457296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:30.763220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7066): Launched 01:30:31.038810 run iperf3-srv_10.42.42.10(pid=7067): Launched 01:30:31.165144 tst iperf3m4.py:8: start network... 01:30:31.372679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:31.900654 run create_hlr_db(pid=7068): Launched 01:30:32.060661 bus /gobi_6: Setting Powered False 01:30:33.121456 run create_hlr_db(pid=7068): Terminated: ok {rc=0} 01:30:33.563835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7070): Launched 01:30:33.890056 run osmo-hlr_10.42.42.2(pid=7071): Launched 01:30:34.013194 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:34.578081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7073): Launched 01:30:34.903207 run osmo-stp_10.42.42.5(pid=7074): Launched 01:30:35.026936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:35.588211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7076): Launched 01:30:35.713473 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:35.988678 run patchelf(pid=7077): Launched 01:30:36.169890 run osmo-stp_10.42.42.5(pid=7074): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7074)] 01:30:36.308429 run osmo-stp_10.42.42.5(pid=7074): stdout: | (launched: 2022-12-09_01:30:34.843826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:36.447948 run osmo-stp_10.42.42.5(pid=7074): stderr: | 20221209013035033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013035033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013035033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013035034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013035034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013035034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013035034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:36.587537 run osmo-stp_10.42.42.5(pid=7074): stdout: | (launched: 2022-12-09_01:30:34.843826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:36.721215 run osmo-stp_10.42.42.5(pid=7074): stderr: | 20221209013035033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013035033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013035033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013035034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013035034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013035034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013035034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:36.878976 run patchelf(pid=7077): Terminating (SIGINT) 01:30:37.061758 run patchelf(pid=7077): Terminated: ok {rc=0} 01:30:37.193576 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7074): Process ended prematurely: osmo-stp_10.42.42.5(pid=7074) [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7074)] [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 01:30:37.203723 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:30:37.232842 run osmo-hlr_10.42.42.2(pid=7071): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7071)] 01:30:37.283569 run osmo-hlr_10.42.42.2(pid=7071): stdout: | (launched: 2022-12-09_01:30:33.830942) 01:30:37.335755 run osmo-hlr_10.42.42.2(pid=7071): stderr: | 20221209013034029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013034029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013034029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013034029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013034029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013034029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013034041 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013034050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013034050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013034050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:37.388478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7060): Terminating (SIGTERM) 01:30:37.430740 run iperf3-srv_10.42.42.10(pid=7061): Terminating (SIGTERM) 01:30:37.472828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7062): Terminating (SIGTERM) 01:30:37.515530 run iperf3-srv_10.42.42.10(pid=7063): Terminating (SIGTERM) 01:30:37.557635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7064): Terminating (SIGTERM) 01:30:37.599827 run iperf3-srv_10.42.42.10(pid=7065): Terminating (SIGTERM) 01:30:37.642231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7066): Terminating (SIGTERM) 01:30:37.684654 run iperf3-srv_10.42.42.10(pid=7067): Terminating (SIGTERM) 01:30:37.726702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7070): Terminating (SIGTERM) 01:30:37.768877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7073): Terminating (SIGTERM) 01:30:37.811077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7076): Terminating (SIGTERM) 01:30:37.853381 --- ParallelTerminationStrategy: PID 7060 died... 01:30:37.873577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7060): Terminated: ok {rc=0} 01:30:37.919994 --- ParallelTerminationStrategy: PID 7061 died... 01:30:37.939657 run iperf3-srv_10.42.42.10(pid=7061): Terminated {rc=256} 01:30:37.986059 --- ParallelTerminationStrategy: PID 7062 died... 01:30:38.005723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7062): Terminated: ok {rc=0} 01:30:38.052132 --- ParallelTerminationStrategy: PID 7063 died... 01:30:38.071807 run iperf3-srv_10.42.42.10(pid=7063): Terminated {rc=256} 01:30:38.118241 --- ParallelTerminationStrategy: PID 7064 died... 01:30:38.137944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7064): Terminated: ok {rc=0} 01:30:38.184526 --- ParallelTerminationStrategy: PID 7065 died... 01:30:38.204204 run iperf3-srv_10.42.42.10(pid=7065): Terminated {rc=256} 01:30:38.250910 --- ParallelTerminationStrategy: PID 7066 died... 01:30:38.270812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7066): Terminated: ok {rc=0} 01:30:38.317467 --- ParallelTerminationStrategy: PID 7067 died... 01:30:38.337169 run iperf3-srv_10.42.42.10(pid=7067): Terminated {rc=256} 01:30:38.383683 --- ParallelTerminationStrategy: PID 7070 died... 01:30:38.403462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7070): Terminated: ok {rc=0} 01:30:38.449960 --- ParallelTerminationStrategy: PID 7073 died... 01:30:38.469662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7073): Terminated: ok {rc=0} 01:30:38.516282 --- ParallelTerminationStrategy: PID 7076 died... 01:30:38.536121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7076): Terminated: ok {rc=0} 01:30:38.624487 bus /gobi_4: Setting Powered False 01:30:39.727214 bus /gobi_4: Setting Powered False 01:30:40.845647 bus /gobi_1: Setting Powered False 01:30:41.953213 bus /gobi_1: Setting Powered False 01:30:43.068761 bus /gobi_0: Setting Powered False 01:30:44.167288 bus /gobi_0: Setting Powered False 01:30:45.282514 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 01:30:46.385427 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:46.398400 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:30:46.453164 tst ping.py: using LAC 18130 01:30:46.579768 tst ping.py: using RAC 25 01:30:46.700676 tst ping.py: using CellId 18130 01:30:46.826625 tst ping.py: using BVCI 18131 01:30:46.941291 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:46.953050 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:46.964734 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:46.977598 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:46.990878 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:47.003309 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:47.016362 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:47.029337 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:47.146878 tst ping.py:19: start network... 01:30:47.350190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:47.811927 run create_hlr_db(pid=7078): Launched 01:30:47.927070 bus /gobi_6: Setting Powered False 01:30:48.986270 run create_hlr_db(pid=7078): Terminated: ok {rc=0} 01:30:49.403072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7080): Launched 01:30:49.701665 run osmo-hlr_10.42.42.2(pid=7081): Launched 01:30:49.816444 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:50.338291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7083): Launched 01:30:50.636892 run osmo-stp_10.42.42.5(pid=7084): Launched 01:30:50.750588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:51.264832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7086): Launched 01:30:51.379642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:51.632712 run patchelf(pid=7087): Launched 01:30:51.799247 run osmo-stp_10.42.42.5(pid=7084): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7084)] 01:30:51.925945 run osmo-stp_10.42.42.5(pid=7084): stdout: | (launched: 2022-12-09_01:30:50.581680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:52.054395 run osmo-stp_10.42.42.5(pid=7084): stderr: | 20221209013050751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013050751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013050751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013050752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013050752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013050752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013050752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:52.183790 run osmo-stp_10.42.42.5(pid=7084): stdout: | (launched: 2022-12-09_01:30:50.581680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:52.306357 run osmo-stp_10.42.42.5(pid=7084): stderr: | 20221209013050751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013050751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013050751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013050752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013050752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013050752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013050752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:52.452305 run patchelf(pid=7087): Terminating (SIGINT) 01:30:52.619508 run patchelf(pid=7087): Terminated: ok {rc=0} 01:30:52.740344 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7084): Process ended prematurely: osmo-stp_10.42.42.5(pid=7084) [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7084)] [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 01:30:52.749358 tst ping.py:22: Test FAILED (6.4 sec) 01:30:52.777089 run osmo-hlr_10.42.42.2(pid=7081): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7081)] 01:30:52.825438 run osmo-hlr_10.42.42.2(pid=7081): stdout: | (launched: 2022-12-09_01:30:49.646610) 01:30:52.875669 run osmo-hlr_10.42.42.2(pid=7081): stderr: | 20221209013049822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013049822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013049822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013049822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013049822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013049823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013049835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013049846 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013049846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013049846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:52.926222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7080): Terminating (SIGTERM) 01:30:52.966340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7083): Terminating (SIGTERM) 01:30:53.006716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7086): Terminating (SIGTERM) 01:30:53.047443 --- ParallelTerminationStrategy: PID 7080 died... 01:30:53.066825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7080): Terminated: ok {rc=0} 01:30:53.111986 --- ParallelTerminationStrategy: PID 7083 died... 01:30:53.130897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7083): Terminated: ok {rc=0} 01:30:53.175841 --- ParallelTerminationStrategy: PID 7086 died... 01:30:53.194749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7086): Terminated: ok {rc=0} 01:30:53.279198 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:30:54.363714 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:54.375587 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:30:54.429271 tst ping_idle_ping.py: using LAC 18131 01:30:54.555685 tst ping_idle_ping.py: using RAC 26 01:30:54.682104 tst ping_idle_ping.py: using CellId 18131 01:30:54.802370 tst ping_idle_ping.py: using BVCI 18132 01:30:54.912791 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:54.923887 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:54.934869 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:54.946177 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:54.957241 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:54.968245 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:54.979538 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:54.990765 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:55.110500 tst ping_idle_ping.py:24: start network... 01:30:55.326939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:55.824569 run create_hlr_db(pid=7088): Launched 01:30:55.955620 bus /gobi_6: Setting Powered False 01:30:57.019012 run create_hlr_db(pid=7088): Terminated: ok {rc=0} 01:30:57.465675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7090): Launched 01:30:57.786316 run osmo-hlr_10.42.42.2(pid=7091): Launched 01:30:57.908402 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:58.463872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7093): Launched 01:30:58.784936 run osmo-stp_10.42.42.5(pid=7094): Launched 01:30:58.907352 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:59.460059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7096): Launched 01:30:59.582494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:59.853385 run patchelf(pid=7097): Launched 01:31:00.032087 run osmo-stp_10.42.42.5(pid=7094): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7094)] 01:31:00.167940 run osmo-stp_10.42.42.5(pid=7094): stdout: | (launched: 2022-12-09_01:30:58.726193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:00.305659 run osmo-stp_10.42.42.5(pid=7094): stderr: | 20221209013058920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013058920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013058921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013058921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013058921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013058922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013058922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:00.443966 run osmo-stp_10.42.42.5(pid=7094): stdout: | (launched: 2022-12-09_01:30:58.726193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:00.575626 run osmo-stp_10.42.42.5(pid=7094): stderr: | 20221209013058920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013058920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013058921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013058921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013058921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013058922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013058922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:00.731595 run patchelf(pid=7097): Terminating (SIGINT) 01:31:00.923605 run patchelf(pid=7097): Terminated: ok {rc=0} 01:31:01.055084 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7094): Process ended prematurely: osmo-stp_10.42.42.5(pid=7094) [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7094)] [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 01:31:01.065437 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:31:01.094611 run osmo-hlr_10.42.42.2(pid=7091): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7091)] 01:31:01.145662 run osmo-hlr_10.42.42.2(pid=7091): stdout: | (launched: 2022-12-09_01:30:57.727376) 01:31:01.198121 run osmo-hlr_10.42.42.2(pid=7091): stderr: | 20221209013057928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013057928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013057928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013057928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013057928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013057928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013057941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013057949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013057950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013057950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:01.250952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7090): Terminating (SIGTERM) 01:31:01.293878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7093): Terminating (SIGTERM) 01:31:01.336691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7096): Terminating (SIGTERM) 01:31:01.379297 --- ParallelTerminationStrategy: PID 7090 died... 01:31:01.399565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7090): Terminated: ok {rc=0} 01:31:01.446326 --- ParallelTerminationStrategy: PID 7093 died... 01:31:01.466662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7093): Terminated: ok {rc=0} 01:31:01.514029 --- ParallelTerminationStrategy: PID 7096 died... 01:31:01.534491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7096): Terminated: ok {rc=0} 01:31:01.624070 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:31:02.925824 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:31:02.932118 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:31:02.967554 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:31:03.006812 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:31:03.095153 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:31:03.128876 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:31:03.167583 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:31:03.756208 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:31:03.811197 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:03.822787 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:31:03.893955 tst cs_paging_gprs_active.py: using LAC 18132 01:31:04.023697 tst cs_paging_gprs_active.py: using RAC 27 01:31:04.151004 tst cs_paging_gprs_active.py: using CellId 18132 01:31:04.278777 tst cs_paging_gprs_active.py: using BVCI 18133 01:31:04.399066 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.410443 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.421610 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.433087 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.444165 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.455449 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.466783 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.477880 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.489241 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:04.611313 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:04.727294 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:31:04.932677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:05.240603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7101): Launched 01:31:05.507921 run iperf3-srv_10.42.42.10(pid=7102): Launched 01:31:05.622846 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:31:05.827255 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:06.134244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7103): Launched 01:31:06.402355 run iperf3-srv_10.42.42.10(pid=7104): Launched 01:31:06.517926 tst cs_paging_gprs_active.py:38: start network... 01:31:06.722369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:07.195664 run create_hlr_db(pid=7105): Launched 01:31:07.314095 bus /gobi_6: Setting Powered False 01:31:08.375358 run create_hlr_db(pid=7105): Terminated: ok {rc=0} 01:31:08.822291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7107): Launched 01:31:09.148408 run osmo-hlr_10.42.42.2(pid=7108): Launched 01:31:09.273134 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:09.831201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7110): Launched 01:31:10.156217 run osmo-stp_10.42.42.5(pid=7111): Launched 01:31:10.280662 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:10.842797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7113): Launched 01:31:10.967660 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:11.237451 run patchelf(pid=7114): Launched 01:31:11.409435 run osmo-stp_10.42.42.5(pid=7111): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7111)] 01:31:11.539920 run osmo-stp_10.42.42.5(pid=7111): stdout: | (launched: 2022-12-09_01:31:10.096869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:11.672726 run osmo-stp_10.42.42.5(pid=7111): stderr: | 20221209013110290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013110291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013110291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013110291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013110292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013110292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013110292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:11.804687 run osmo-stp_10.42.42.5(pid=7111): stdout: | (launched: 2022-12-09_01:31:10.096869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:11.930441 run osmo-stp_10.42.42.5(pid=7111): stderr: | 20221209013110290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013110291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013110291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013110291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013110292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013110292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013110292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:12.079277 run patchelf(pid=7114): Terminating (SIGINT) 01:31:12.252202 run patchelf(pid=7114): Terminated: ok {rc=0} 01:31:12.377484 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7111): Process ended prematurely: osmo-stp_10.42.42.5(pid=7111) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7111)] [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:31:12.386901 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 01:31:12.414738 run osmo-hlr_10.42.42.2(pid=7108): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7108)] 01:31:12.463067 run osmo-hlr_10.42.42.2(pid=7108): stdout: | (launched: 2022-12-09_01:31:09.089147) 01:31:12.513401 run osmo-hlr_10.42.42.2(pid=7108): stderr: | 20221209013109289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013109289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013109289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013109289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013109290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013109290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013109301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013109312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013109312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013109312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:12.563946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7101): Terminating (SIGTERM) 01:31:12.604175 run iperf3-srv_10.42.42.10(pid=7102): Terminating (SIGTERM) 01:31:12.644353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7103): Terminating (SIGTERM) 01:31:12.684494 run iperf3-srv_10.42.42.10(pid=7104): Terminating (SIGTERM) 01:31:12.724376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7107): Terminating (SIGTERM) 01:31:12.764346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7110): Terminating (SIGTERM) 01:31:12.804409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7113): Terminating (SIGTERM) 01:31:12.844737 --- ParallelTerminationStrategy: PID 7101 died... 01:31:12.864217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7101): Terminated: ok {rc=0} 01:31:12.908863 --- ParallelTerminationStrategy: PID 7102 died... 01:31:12.928077 run iperf3-srv_10.42.42.10(pid=7102): Terminated {rc=256} 01:31:12.972581 --- ParallelTerminationStrategy: PID 7103 died... 01:31:12.991448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7103): Terminated: ok {rc=0} 01:31:13.035898 --- ParallelTerminationStrategy: PID 7104 died... 01:31:13.054639 run iperf3-srv_10.42.42.10(pid=7104): Terminated {rc=256} 01:31:13.099183 --- ParallelTerminationStrategy: PID 7107 died... 01:31:13.117968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7107): Terminated: ok {rc=0} 01:31:13.162362 --- ParallelTerminationStrategy: PID 7110 died... 01:31:13.180924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7110): Terminated: ok {rc=0} 01:31:13.225880 --- ParallelTerminationStrategy: PID 7113 died... 01:31:13.244691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7113): Terminated: ok {rc=0} 01:31:13.331423 bus /gobi_0: Setting Powered False 01:31:14.432116 bus /gobi_0: Setting Powered False 01:31:15.548023 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:31:16.729544 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:16.746700 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:31:16.828053 tst iperf3.py: using LAC 18133 01:31:16.961439 tst iperf3.py: using RAC 28 01:31:17.092651 tst iperf3.py: using CellId 18133 01:31:17.214038 tst iperf3.py: using BVCI 18134 01:31:17.327743 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:17.339273 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:17.350597 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:17.362797 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:17.375146 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:17.386089 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:17.397856 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:17.409835 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:17.422231 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:17.541576 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:31:17.762510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:18.089539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7115): Launched 01:31:18.374525 run iperf3-srv_10.42.42.10(pid=7116): Launched 01:31:18.497189 tst iperf3.py:8: start network... 01:31:18.717907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:19.221768 run create_hlr_db(pid=7117): Launched 01:31:19.353863 bus /gobi_6: Setting Powered False 01:31:20.417848 run create_hlr_db(pid=7117): Terminated: ok {rc=0} 01:31:20.851291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7119): Launched 01:31:21.155693 run osmo-hlr_10.42.42.2(pid=7120): Launched 01:31:21.272084 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:21.800484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7122): Launched 01:31:22.105116 run osmo-stp_10.42.42.5(pid=7123): Launched 01:31:22.222605 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:22.747839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7125): Launched 01:31:22.865575 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:23.121716 run patchelf(pid=7126): Launched 01:31:23.291169 run osmo-stp_10.42.42.5(pid=7123): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7123)] 01:31:23.420465 run osmo-stp_10.42.42.5(pid=7123): stdout: | (launched: 2022-12-09_01:31:22.049202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:23.551100 run osmo-stp_10.42.42.5(pid=7123): stderr: | 20221209013122220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013122220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013122220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013122220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013122221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013122221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013122221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:23.682527 run osmo-stp_10.42.42.5(pid=7123): stdout: | (launched: 2022-12-09_01:31:22.049202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:23.807350 run osmo-stp_10.42.42.5(pid=7123): stderr: | 20221209013122220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013122220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013122220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013122220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013122221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013122221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013122221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:23.955075 run patchelf(pid=7126): Terminating (SIGINT) 01:31:24.126565 run patchelf(pid=7126): Terminated: ok {rc=0} 01:31:24.250157 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7123): Process ended prematurely: osmo-stp_10.42.42.5(pid=7123) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7123)] [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 01:31:24.259617 tst iperf3.py:8: Test FAILED (7.6 sec) 01:31:24.287824 run osmo-hlr_10.42.42.2(pid=7120): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7120)] 01:31:24.336405 run osmo-hlr_10.42.42.2(pid=7120): stdout: | (launched: 2022-12-09_01:31:21.099970) 01:31:24.386764 run osmo-hlr_10.42.42.2(pid=7120): stderr: | 20221209013121277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013121277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013121277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013121277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013121277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013121277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013121291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013121299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013121299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013121299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:24.437366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7115): Terminating (SIGTERM) 01:31:24.477905 run iperf3-srv_10.42.42.10(pid=7116): Terminating (SIGTERM) 01:31:24.518100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7119): Terminating (SIGTERM) 01:31:24.558544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7122): Terminating (SIGTERM) 01:31:24.598752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7125): Terminating (SIGTERM) 01:31:24.639492 --- ParallelTerminationStrategy: PID 7115 died... 01:31:24.658835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7115): Terminated: ok {rc=0} 01:31:24.704181 --- ParallelTerminationStrategy: PID 7116 died... 01:31:24.723165 run iperf3-srv_10.42.42.10(pid=7116): Terminated {rc=256} 01:31:24.767894 --- ParallelTerminationStrategy: PID 7119 died... 01:31:24.786804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7119): Terminated: ok {rc=0} 01:31:24.831662 --- ParallelTerminationStrategy: PID 7122 died... 01:31:24.850930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7122): Terminated: ok {rc=0} 01:31:24.895613 --- ParallelTerminationStrategy: PID 7125 died... 01:31:24.914485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7125): Terminated: ok {rc=0} 01:31:25.000897 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:31:26.148467 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:26.160174 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:31:26.230127 tst iperf3m4.py: using LAC 18134 01:31:26.349990 tst iperf3m4.py: using RAC 29 01:31:26.470866 tst iperf3m4.py: using CellId 18134 01:31:26.592785 tst iperf3m4.py: using BVCI 18135 01:31:26.705328 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:26.716214 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:26.726827 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:26.737785 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:26.748540 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:26.759377 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:26.770400 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:26.781215 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:26.792200 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:26.910709 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:27.030742 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:27.145449 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:27.266324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:31:27.471327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:27.776645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7127): Launched 01:31:28.041910 run iperf3-srv_10.42.42.10(pid=7128): Launched 01:31:28.156495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:31:28.359952 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:28.665568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7129): Launched 01:31:28.930851 run iperf3-srv_10.42.42.10(pid=7130): Launched 01:31:29.045290 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:31:29.247905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:29.552816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7131): Launched 01:31:29.818100 run iperf3-srv_10.42.42.10(pid=7132): Launched 01:31:29.932091 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:31:30.135181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:30.440030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7133): Launched 01:31:30.706075 run iperf3-srv_10.42.42.10(pid=7134): Launched 01:31:30.820233 tst iperf3m4.py:8: start network... 01:31:31.027952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:31.511085 run create_hlr_db(pid=7135): Launched 01:31:31.664322 bus /gobi_6: Setting Powered False 01:31:32.725152 run create_hlr_db(pid=7135): Terminated: ok {rc=0} 01:31:33.169627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7137): Launched 01:31:33.495425 run osmo-hlr_10.42.42.2(pid=7138): Launched 01:31:33.620557 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:34.179571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7140): Launched 01:31:34.502634 run osmo-stp_10.42.42.5(pid=7141): Launched 01:31:34.626564 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:35.186043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7143): Launched 01:31:35.309977 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:35.583619 run patchelf(pid=7144): Launched 01:31:35.763998 run osmo-stp_10.42.42.5(pid=7141): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7141)] 01:31:35.901801 run osmo-stp_10.42.42.5(pid=7141): stdout: | (launched: 2022-12-09_01:31:34.443425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:36.040541 run osmo-stp_10.42.42.5(pid=7141): stderr: | 20221209013134633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013134633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013134633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013134634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013134634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013134634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013134634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:36.179142 run osmo-stp_10.42.42.5(pid=7141): stdout: | (launched: 2022-12-09_01:31:34.443425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:36.311416 run osmo-stp_10.42.42.5(pid=7141): stderr: | 20221209013134633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013134633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013134633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013134634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013134634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013134634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013134634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:36.468854 run patchelf(pid=7144): Terminating (SIGINT) 01:31:36.650848 run patchelf(pid=7144): Terminated: ok {rc=0} 01:31:36.782842 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7141): Process ended prematurely: osmo-stp_10.42.42.5(pid=7141) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7141)] [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:31:36.793103 tst iperf3m4.py:8: Test FAILED (10.7 sec) 01:31:36.822143 run osmo-hlr_10.42.42.2(pid=7138): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7138)] 01:31:36.873158 run osmo-hlr_10.42.42.2(pid=7138): stdout: | (launched: 2022-12-09_01:31:33.435763) 01:31:36.925448 run osmo-hlr_10.42.42.2(pid=7138): stderr: | 20221209013133631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013133631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013133631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013133631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013133631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013133631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013133643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013133652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013133652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013133652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:36.978008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7127): Terminating (SIGTERM) 01:31:37.020189 run iperf3-srv_10.42.42.10(pid=7128): Terminating (SIGTERM) 01:31:37.062141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7129): Terminating (SIGTERM) 01:31:37.104573 run iperf3-srv_10.42.42.10(pid=7130): Terminating (SIGTERM) 01:31:37.146445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7131): Terminating (SIGTERM) 01:31:37.188388 run iperf3-srv_10.42.42.10(pid=7132): Terminating (SIGTERM) 01:31:37.230233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7133): Terminating (SIGTERM) 01:31:37.272163 run iperf3-srv_10.42.42.10(pid=7134): Terminating (SIGTERM) 01:31:37.314004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7137): Terminating (SIGTERM) 01:31:37.355989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7140): Terminating (SIGTERM) 01:31:37.398121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7143): Terminating (SIGTERM) 01:31:37.440388 --- ParallelTerminationStrategy: PID 7127 died... 01:31:37.460600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7127): Terminated: ok {rc=0} 01:31:37.507509 --- ParallelTerminationStrategy: PID 7128 died... 01:31:37.527401 run iperf3-srv_10.42.42.10(pid=7128): Terminated {rc=256} 01:31:37.573954 --- ParallelTerminationStrategy: PID 7129 died... 01:31:37.593816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7129): Terminated: ok {rc=0} 01:31:37.640139 --- ParallelTerminationStrategy: PID 7130 died... 01:31:37.660113 run iperf3-srv_10.42.42.10(pid=7130): Terminated {rc=256} 01:31:37.706656 --- ParallelTerminationStrategy: PID 7131 died... 01:31:37.726305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7131): Terminated: ok {rc=0} 01:31:37.772347 --- ParallelTerminationStrategy: PID 7132 died... 01:31:37.791877 run iperf3-srv_10.42.42.10(pid=7132): Terminated {rc=256} 01:31:37.837913 --- ParallelTerminationStrategy: PID 7133 died... 01:31:37.857565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7133): Terminated: ok {rc=0} 01:31:37.903660 --- ParallelTerminationStrategy: PID 7134 died... 01:31:37.923321 run iperf3-srv_10.42.42.10(pid=7134): Terminated {rc=256} 01:31:37.969299 --- ParallelTerminationStrategy: PID 7137 died... 01:31:37.988916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7137): Terminated: ok {rc=0} 01:31:38.035099 --- ParallelTerminationStrategy: PID 7140 died... 01:31:38.054679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7140): Terminated: ok {rc=0} 01:31:38.100749 --- ParallelTerminationStrategy: PID 7143 died... 01:31:38.120465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7143): Terminated: ok {rc=0} 01:31:38.208123 bus /gobi_4: Setting Powered False 01:31:39.307935 bus /gobi_4: Setting Powered False 01:31:40.426316 bus /gobi_1: Setting Powered False 01:31:41.524594 bus /gobi_1: Setting Powered False 01:31:42.640819 bus /gobi_0: Setting Powered False 01:31:43.739879 bus /gobi_0: Setting Powered False 01:31:44.858655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:31:45.981680 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:45.996827 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:31:46.085850 tst ping.py: using LAC 18135 01:31:46.212054 tst ping.py: using RAC 30 01:31:46.339844 tst ping.py: using CellId 18135 01:31:46.465272 tst ping.py: using BVCI 18136 01:31:46.610957 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:46.624214 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:46.640785 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:46.657097 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:46.672725 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:46.689034 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:46.705997 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:46.721957 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:46.867231 tst ping.py:19: start network... 01:31:47.092206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:47.577687 run create_hlr_db(pid=7146): Launched 01:31:47.691707 bus /gobi_6: Setting Powered False 01:31:48.751172 run create_hlr_db(pid=7146): Terminated: ok {rc=0} 01:31:49.189291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7148): Launched 01:31:49.508609 run osmo-hlr_10.42.42.2(pid=7149): Launched 01:31:49.630758 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:50.187375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7151): Launched 01:31:50.506572 run osmo-stp_10.42.42.5(pid=7152): Launched 01:31:50.628175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:51.180506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7154): Launched 01:31:51.302443 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:51.571695 run patchelf(pid=7155): Launched 01:31:51.750024 run osmo-stp_10.42.42.5(pid=7152): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7152)] 01:31:51.884909 run osmo-stp_10.42.42.5(pid=7152): stdout: | (launched: 2022-12-09_01:31:50.447898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:52.021810 run osmo-stp_10.42.42.5(pid=7152): stderr: | 20221209013150641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013150641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013150641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013150642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013150642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013150642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013150642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:52.158683 run osmo-stp_10.42.42.5(pid=7152): stdout: | (launched: 2022-12-09_01:31:50.447898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:52.288823 run osmo-stp_10.42.42.5(pid=7152): stderr: | 20221209013150641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013150641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013150641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013150642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013150642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013150642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013150642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:52.443399 run patchelf(pid=7155): Terminating (SIGINT) 01:31:52.621546 run patchelf(pid=7155): Terminated: ok {rc=0} 01:31:52.750703 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7152): Process ended prematurely: osmo-stp_10.42.42.5(pid=7152) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7152)] [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 01:31:52.760342 tst ping.py:22: Test FAILED (6.8 sec) 01:31:52.788762 run osmo-hlr_10.42.42.2(pid=7149): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7149)] 01:31:52.839363 run osmo-hlr_10.42.42.2(pid=7149): stdout: | (launched: 2022-12-09_01:31:49.450139) 01:31:52.891321 run osmo-hlr_10.42.42.2(pid=7149): stderr: | 20221209013149649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013149649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013149649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013149649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013149649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013149649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013149661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013149669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013149671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013149671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:52.943594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7148): Terminating (SIGTERM) 01:31:52.985520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7151): Terminating (SIGTERM) 01:31:53.027440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7154): Terminating (SIGTERM) 01:31:53.069567 --- ParallelTerminationStrategy: PID 7148 died... 01:31:53.089783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7148): Terminated: ok {rc=0} 01:31:53.136214 --- ParallelTerminationStrategy: PID 7151 died... 01:31:53.155730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7151): Terminated: ok {rc=0} 01:31:53.202575 --- ParallelTerminationStrategy: PID 7154 died... 01:31:53.222407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7154): Terminated: ok {rc=0} 01:31:53.311293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:31:54.400851 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:54.413471 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:31:54.486181 tst ping_idle_ping.py: using LAC 18136 01:31:54.612547 tst ping_idle_ping.py: using RAC 31 01:31:54.737824 tst ping_idle_ping.py: using CellId 18136 01:31:54.862515 tst ping_idle_ping.py: using BVCI 18137 01:31:54.980199 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:54.991647 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:55.002854 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:55.014066 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:55.025249 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:55.036364 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:55.047588 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:55.058778 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:55.178628 tst ping_idle_ping.py:24: start network... 01:31:55.396169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:55.895857 run create_hlr_db(pid=7156): Launched 01:31:56.026552 bus /gobi_6: Setting Powered False 01:31:57.090829 run create_hlr_db(pid=7156): Terminated: ok {rc=0} 01:31:57.523407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7158): Launched 01:31:57.826133 run osmo-hlr_10.42.42.2(pid=7159): Launched 01:31:57.940204 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:58.457393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7161): Launched 01:31:58.757047 run osmo-stp_10.42.42.5(pid=7162): Launched 01:31:58.871684 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:59.388009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7164): Launched 01:31:59.503247 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:59.757205 run patchelf(pid=7165): Launched 01:31:59.924359 run osmo-stp_10.42.42.5(pid=7162): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7162)] 01:32:00.051749 run osmo-stp_10.42.42.5(pid=7162): stdout: | (launched: 2022-12-09_01:31:58.701622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:00.180705 run osmo-stp_10.42.42.5(pid=7162): stderr: | 20221209013158872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013158872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013158872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013158873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013158873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013158873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013158873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:00.309661 run osmo-stp_10.42.42.5(pid=7162): stdout: | (launched: 2022-12-09_01:31:58.701622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:00.432349 run osmo-stp_10.42.42.5(pid=7162): stderr: | 20221209013158872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013158872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013158872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013158873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013158873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013158873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013158873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:00.578202 run patchelf(pid=7165): Terminating (SIGINT) 01:32:00.746712 run patchelf(pid=7165): Terminated: ok {rc=0} 01:32:00.882398 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7162): Process ended prematurely: osmo-stp_10.42.42.5(pid=7162) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7162)] [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:32:00.892294 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:32:00.935595 run osmo-hlr_10.42.42.2(pid=7159): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7159)] 01:32:00.985636 run osmo-hlr_10.42.42.2(pid=7159): stdout: | (launched: 2022-12-09_01:31:57.770735) 01:32:01.040292 run osmo-hlr_10.42.42.2(pid=7159): stderr: | 20221209013157946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013157946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013157946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013157946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013157946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013157946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013157958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013157967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013157967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013157967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:01.097495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7158): Terminating (SIGTERM) 01:32:01.142787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7161): Terminating (SIGTERM) 01:32:01.189459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7164): Terminating (SIGTERM) 01:32:01.236653 --- ParallelTerminationStrategy: PID 7158 died... 01:32:01.257894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7158): Terminated: ok {rc=0} 01:32:01.309794 --- ParallelTerminationStrategy: PID 7161 died... 01:32:01.330675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7161): Terminated: ok {rc=0} 01:32:01.380746 --- ParallelTerminationStrategy: PID 7164 died... 01:32:01.401900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7164): Terminated: ok {rc=0} 01:32:01.496580 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:32:02.799421 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:32:02.805651 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:32:02.839647 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:32:02.878147 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:32:02.962941 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:32:02.995710 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:32:03.033904 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:32:03.629190 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:32:03.678722 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:03.689589 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:32:03.757036 tst cs_paging_gprs_active.py: using LAC 18137 01:32:03.875466 tst cs_paging_gprs_active.py: using RAC 32 01:32:03.994433 tst cs_paging_gprs_active.py: using CellId 18137 01:32:04.126060 tst cs_paging_gprs_active.py: using BVCI 18138 01:32:04.246479 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.258007 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.269461 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.280723 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.292032 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.303229 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.314538 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.325761 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.337669 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:04.452240 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:04.577333 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:32:04.798792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:32:05.127498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7170): Launched 01:32:05.412447 run iperf3-srv_10.42.42.10(pid=7171): Launched 01:32:05.534954 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:32:05.755621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:32:06.083529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7172): Launched 01:32:06.367989 run iperf3-srv_10.42.42.10(pid=7173): Launched 01:32:06.490642 tst cs_paging_gprs_active.py:38: start network... 01:32:06.710972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:07.216666 run create_hlr_db(pid=7174): Launched 01:32:07.348683 bus /gobi_6: Setting Powered False 01:32:08.413039 run create_hlr_db(pid=7174): Terminated: ok {rc=0} 01:32:08.866359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7176): Launched 01:32:09.193066 run osmo-hlr_10.42.42.2(pid=7177): Launched 01:32:09.318046 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:09.878888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7179): Launched 01:32:10.205580 run osmo-stp_10.42.42.5(pid=7180): Launched 01:32:10.330744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:10.894750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7182): Launched 01:32:11.020207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:11.295890 run patchelf(pid=7183): Launched 01:32:11.479599 run osmo-stp_10.42.42.5(pid=7180): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7180)] 01:32:11.617308 run osmo-stp_10.42.42.5(pid=7180): stdout: | (launched: 2022-12-09_01:32:10.145775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:11.757873 run osmo-stp_10.42.42.5(pid=7180): stderr: | 20221209013210337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013210337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013210337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013210338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013210338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013210338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013210338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:11.897969 run osmo-stp_10.42.42.5(pid=7180): stdout: | (launched: 2022-12-09_01:32:10.145775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:12.031037 run osmo-stp_10.42.42.5(pid=7180): stderr: | 20221209013210337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013210337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013210337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013210338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013210338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013210338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013210338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:12.188738 run patchelf(pid=7183): Terminating (SIGINT) 01:32:12.370805 run patchelf(pid=7183): Terminated: ok {rc=0} 01:32:12.502357 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7180): Process ended prematurely: osmo-stp_10.42.42.5(pid=7180) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7180)] [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:32:12.512512 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 01:32:12.541134 run osmo-hlr_10.42.42.2(pid=7177): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7177)] 01:32:12.590950 run osmo-hlr_10.42.42.2(pid=7177): stdout: | (launched: 2022-12-09_01:32:09.133361) 01:32:12.642423 run osmo-hlr_10.42.42.2(pid=7177): stderr: | 20221209013209333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013209333 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013209333 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013209333 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013209333 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013209333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013209354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013209364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013209364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013209364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:12.694577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7170): Terminating (SIGTERM) 01:32:12.736530 run iperf3-srv_10.42.42.10(pid=7171): Terminating (SIGTERM) 01:32:12.778291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7172): Terminating (SIGTERM) 01:32:12.819964 run iperf3-srv_10.42.42.10(pid=7173): Terminating (SIGTERM) 01:32:12.861547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7176): Terminating (SIGTERM) 01:32:12.903224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7179): Terminating (SIGTERM) 01:32:12.944748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7182): Terminating (SIGTERM) 01:32:12.987507 --- ParallelTerminationStrategy: PID 7170 died... 01:32:13.007593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7170): Terminated: ok {rc=0} 01:32:13.053823 --- ParallelTerminationStrategy: PID 7171 died... 01:32:13.073385 run iperf3-srv_10.42.42.10(pid=7171): Terminated {rc=256} 01:32:13.119334 --- ParallelTerminationStrategy: PID 7172 died... 01:32:13.138955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7172): Terminated: ok {rc=0} 01:32:13.184789 --- ParallelTerminationStrategy: PID 7173 died... 01:32:13.204606 run iperf3-srv_10.42.42.10(pid=7173): Terminated {rc=256} 01:32:13.250325 --- ParallelTerminationStrategy: PID 7176 died... 01:32:13.269740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7176): Terminated: ok {rc=0} 01:32:13.315563 --- ParallelTerminationStrategy: PID 7179 died... 01:32:13.335194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7179): Terminated: ok {rc=0} 01:32:13.381133 --- ParallelTerminationStrategy: PID 7182 died... 01:32:13.400570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7182): Terminated: ok {rc=0} 01:32:13.487842 bus /gobi_0: Setting Powered False 01:32:14.585796 bus /gobi_0: Setting Powered False 01:32:15.697372 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:32:16.842904 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:16.855382 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:32:16.928648 tst iperf3.py: using LAC 18138 01:32:17.057310 tst iperf3.py: using RAC 33 01:32:17.199611 tst iperf3.py: using CellId 18138 01:32:17.328836 tst iperf3.py: using BVCI 18139 01:32:17.448630 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:17.459938 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:17.471034 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:17.482151 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:17.493125 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:17.504203 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:17.515391 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:17.526382 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:17.537533 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:17.656515 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:32:17.877281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:32:18.203415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7184): Launched 01:32:18.487101 run iperf3-srv_10.42.42.10(pid=7185): Launched 01:32:18.608804 tst iperf3.py:8: start network... 01:32:18.828450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:19.332165 run create_hlr_db(pid=7186): Launched 01:32:19.465261 bus /gobi_6: Setting Powered False 01:32:20.526072 run create_hlr_db(pid=7186): Terminated: ok {rc=0} 01:32:20.977998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7188): Launched 01:32:21.305124 run osmo-hlr_10.42.42.2(pid=7189): Launched 01:32:21.429837 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:21.991203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7191): Launched 01:32:22.316742 run osmo-stp_10.42.42.5(pid=7192): Launched 01:32:22.441926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:23.006276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7194): Launched 01:32:23.131679 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:23.405807 run patchelf(pid=7195): Launched 01:32:23.586812 run osmo-stp_10.42.42.5(pid=7192): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7192)] 01:32:23.725387 run osmo-stp_10.42.42.5(pid=7192): stdout: | (launched: 2022-12-09_01:32:22.257050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:23.865381 run osmo-stp_10.42.42.5(pid=7192): stderr: | 20221209013222448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013222448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013222449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013222449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013222450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013222450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013222450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:24.005161 run osmo-stp_10.42.42.5(pid=7192): stdout: | (launched: 2022-12-09_01:32:22.257050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:24.138186 run osmo-stp_10.42.42.5(pid=7192): stderr: | 20221209013222448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013222448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013222449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013222449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013222450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013222450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013222450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:24.295852 run patchelf(pid=7195): Terminating (SIGINT) 01:32:24.478603 run patchelf(pid=7195): Terminated: ok {rc=0} 01:32:24.609852 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7192): Process ended prematurely: osmo-stp_10.42.42.5(pid=7192) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7192)] [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 01:32:24.619874 tst iperf3.py:8: Test FAILED (7.8 sec) 01:32:24.648751 run osmo-hlr_10.42.42.2(pid=7189): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7189)] 01:32:24.699177 run osmo-hlr_10.42.42.2(pid=7189): stdout: | (launched: 2022-12-09_01:32:21.245414) 01:32:24.751192 run osmo-hlr_10.42.42.2(pid=7189): stderr: | 20221209013221443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013221443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013221444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013221444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013221444 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013221444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013221456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013221465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013221465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013221465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:24.803399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7184): Terminating (SIGTERM) 01:32:24.845195 run iperf3-srv_10.42.42.10(pid=7185): Terminating (SIGTERM) 01:32:24.886828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7188): Terminating (SIGTERM) 01:32:24.928475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7191): Terminating (SIGTERM) 01:32:24.970236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7194): Terminating (SIGTERM) 01:32:25.012550 --- ParallelTerminationStrategy: PID 7184 died... 01:32:25.032828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7184): Terminated: ok {rc=0} 01:32:25.079528 --- ParallelTerminationStrategy: PID 7185 died... 01:32:25.099395 run iperf3-srv_10.42.42.10(pid=7185): Terminated {rc=256} 01:32:25.145602 --- ParallelTerminationStrategy: PID 7188 died... 01:32:25.165247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7188): Terminated: ok {rc=0} 01:32:25.211522 --- ParallelTerminationStrategy: PID 7191 died... 01:32:25.231232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7191): Terminated: ok {rc=0} 01:32:25.277324 --- ParallelTerminationStrategy: PID 7194 died... 01:32:25.296869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7194): Terminated: ok {rc=0} 01:32:25.384597 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:32:26.535135 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:26.547143 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:32:26.620451 tst iperf3m4.py: using LAC 18139 01:32:26.750109 tst iperf3m4.py: using RAC 34 01:32:26.877143 tst iperf3m4.py: using CellId 18139 01:32:27.004677 tst iperf3m4.py: using BVCI 18140 01:32:27.124873 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:27.136340 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:27.147603 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:27.158841 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:27.170031 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:27.181202 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:27.192503 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:27.203595 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:27.214905 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:27.334391 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:27.452882 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:27.575332 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:27.697241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:32:27.918416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:32:28.245969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7196): Launched 01:32:28.531802 run iperf3-srv_10.42.42.10(pid=7197): Launched 01:32:28.654995 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:32:28.876225 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:32:29.205389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7198): Launched 01:32:29.490019 run iperf3-srv_10.42.42.10(pid=7199): Launched 01:32:29.612575 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:32:29.833031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:32:30.160913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7200): Launched 01:32:30.444398 run iperf3-srv_10.42.42.10(pid=7201): Launched 01:32:30.566422 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:32:30.786024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:32:31.125087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7202): Launched 01:32:31.426076 run iperf3-srv_10.42.42.10(pid=7203): Launched 01:32:31.558865 tst iperf3m4.py:8: start network... 01:32:31.782314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:32.284716 run create_hlr_db(pid=7204): Launched 01:32:32.444836 bus /gobi_6: Setting Powered False 01:32:33.509209 run create_hlr_db(pid=7204): Terminated: ok {rc=0} 01:32:33.961588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7206): Launched 01:32:34.286996 run osmo-hlr_10.42.42.2(pid=7207): Launched 01:32:34.410571 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:34.972025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7209): Launched 01:32:35.296794 run osmo-stp_10.42.42.5(pid=7210): Launched 01:32:35.419880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:35.982321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7214): Launched 01:32:36.106691 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:36.381201 run patchelf(pid=7215): Launched 01:32:36.561907 run osmo-stp_10.42.42.5(pid=7210): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7210)] 01:32:36.699978 run osmo-stp_10.42.42.5(pid=7210): stdout: | (launched: 2022-12-09_01:32:35.237346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:36.839052 run osmo-stp_10.42.42.5(pid=7210): stderr: | 20221209013235426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013235426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013235427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013235427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013235427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013235428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013235428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:36.978131 run osmo-stp_10.42.42.5(pid=7210): stdout: | (launched: 2022-12-09_01:32:35.237346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:37.111049 run osmo-stp_10.42.42.5(pid=7210): stderr: | 20221209013235426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013235426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013235427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013235427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013235427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013235428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013235428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:37.268200 run patchelf(pid=7215): Terminating (SIGINT) 01:32:37.450053 run patchelf(pid=7215): Terminated: ok {rc=0} 01:32:37.581384 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7210): Process ended prematurely: osmo-stp_10.42.42.5(pid=7210) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7210)] [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:32:37.591458 tst iperf3m4.py:8: Test FAILED (11.1 sec) 01:32:37.620476 run osmo-hlr_10.42.42.2(pid=7207): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7207)] 01:32:37.670570 run osmo-hlr_10.42.42.2(pid=7207): stdout: | (launched: 2022-12-09_01:32:34.227313) 01:32:37.722994 run osmo-hlr_10.42.42.2(pid=7207): stderr: | 20221209013234423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013234423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013234423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013234423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013234423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013234423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013234436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013234444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013234444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013234444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:37.775593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7196): Terminating (SIGTERM) 01:32:37.817491 run iperf3-srv_10.42.42.10(pid=7197): Terminating (SIGTERM) 01:32:37.859576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7198): Terminating (SIGTERM) 01:32:37.901814 run iperf3-srv_10.42.42.10(pid=7199): Terminating (SIGTERM) 01:32:37.943826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7200): Terminating (SIGTERM) 01:32:37.986033 run iperf3-srv_10.42.42.10(pid=7201): Terminating (SIGTERM) 01:32:38.028100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7202): Terminating (SIGTERM) 01:32:38.070661 run iperf3-srv_10.42.42.10(pid=7203): Terminating (SIGTERM) 01:32:38.112712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7206): Terminating (SIGTERM) 01:32:38.155456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7209): Terminating (SIGTERM) 01:32:38.197567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7214): Terminating (SIGTERM) 01:32:38.240016 --- ParallelTerminationStrategy: PID 7196 died... 01:32:38.260351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7196): Terminated: ok {rc=0} 01:32:38.306983 --- ParallelTerminationStrategy: PID 7197 died... 01:32:38.326679 run iperf3-srv_10.42.42.10(pid=7197): Terminated {rc=256} 01:32:38.372896 --- ParallelTerminationStrategy: PID 7198 died... 01:32:38.392909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7198): Terminated: ok {rc=0} 01:32:38.439193 --- ParallelTerminationStrategy: PID 7199 died... 01:32:38.458817 run iperf3-srv_10.42.42.10(pid=7199): Terminated {rc=256} 01:32:38.504782 --- ParallelTerminationStrategy: PID 7200 died... 01:32:38.524780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7200): Terminated: ok {rc=0} 01:32:38.570787 --- ParallelTerminationStrategy: PID 7201 died... 01:32:38.590310 run iperf3-srv_10.42.42.10(pid=7201): Terminated {rc=256} 01:32:38.636166 --- ParallelTerminationStrategy: PID 7202 died... 01:32:38.655869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7202): Terminated: ok {rc=0} 01:32:38.702292 --- ParallelTerminationStrategy: PID 7203 died... 01:32:38.721897 run iperf3-srv_10.42.42.10(pid=7203): Terminated {rc=256} 01:32:38.767941 --- ParallelTerminationStrategy: PID 7206 died... 01:32:38.787541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7206): Terminated: ok {rc=0} 01:32:38.833491 --- ParallelTerminationStrategy: PID 7209 died... 01:32:38.853138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7209): Terminated: ok {rc=0} 01:32:38.899237 --- ParallelTerminationStrategy: PID 7214 died... 01:32:38.918894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7214): Terminated: ok {rc=0} 01:32:39.006738 bus /gobi_4: Setting Powered False 01:32:40.106975 bus /gobi_4: Setting Powered False 01:32:41.225393 bus /gobi_1: Setting Powered False 01:32:42.324793 bus /gobi_1: Setting Powered False 01:32:43.439948 bus /gobi_0: Setting Powered False 01:32:44.535899 bus /gobi_0: Setting Powered False 01:32:45.651441 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:32:46.753851 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:46.767002 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:32:46.841442 tst ping.py: using LAC 18140 01:32:46.961432 tst ping.py: using RAC 35 01:32:47.081348 tst ping.py: using CellId 18140 01:32:47.211373 tst ping.py: using BVCI 18141 01:32:47.321811 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:47.332882 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:47.343782 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:47.354872 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:47.365967 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:47.377075 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:47.388184 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:47.399074 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:47.515749 tst ping.py:19: start network... 01:32:47.732364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:48.227914 run create_hlr_db(pid=7218): Launched 01:32:48.359361 bus /gobi_6: Setting Powered False 01:32:49.422810 run create_hlr_db(pid=7218): Terminated: ok {rc=0} 01:32:49.852029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7220): Launched 01:32:50.153898 run osmo-hlr_10.42.42.2(pid=7221): Launched 01:32:50.268756 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:50.801395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7223): Launched 01:32:51.100619 run osmo-stp_10.42.42.5(pid=7224): Launched 01:32:51.215080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:51.729789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7226): Launched 01:32:51.845166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:52.099620 run patchelf(pid=7227): Launched 01:32:52.266168 run osmo-stp_10.42.42.5(pid=7224): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7224)] 01:32:52.393277 run osmo-stp_10.42.42.5(pid=7224): stdout: | (launched: 2022-12-09_01:32:51.044660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:52.521598 run osmo-stp_10.42.42.5(pid=7224): stderr: | 20221209013251213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013251213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013251213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013251214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013251214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013251214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013251214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:52.650185 run osmo-stp_10.42.42.5(pid=7224): stdout: | (launched: 2022-12-09_01:32:51.044660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:52.772801 run osmo-stp_10.42.42.5(pid=7224): stderr: | 20221209013251213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013251213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013251213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013251214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013251214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013251214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013251214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:52.918091 run patchelf(pid=7227): Terminating (SIGINT) 01:32:53.086202 run patchelf(pid=7227): Terminated: ok {rc=0} 01:32:53.208200 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7224): Process ended prematurely: osmo-stp_10.42.42.5(pid=7224) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7224)] [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 01:32:53.217231 tst ping.py:22: Test FAILED (6.5 sec) 01:32:53.244685 run osmo-hlr_10.42.42.2(pid=7221): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7221)] 01:32:53.292701 run osmo-hlr_10.42.42.2(pid=7221): stdout: | (launched: 2022-12-09_01:32:50.097988) 01:32:53.342523 run osmo-hlr_10.42.42.2(pid=7221): stderr: | 20221209013250275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013250275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013250275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013250275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013250275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013250275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013250287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013250297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013250298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013250298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:53.392666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7220): Terminating (SIGTERM) 01:32:53.432660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7223): Terminating (SIGTERM) 01:32:53.472559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7226): Terminating (SIGTERM) 01:32:53.512912 --- ParallelTerminationStrategy: PID 7220 died... 01:32:53.532237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7220): Terminated: ok {rc=0} 01:32:53.576930 --- ParallelTerminationStrategy: PID 7223 died... 01:32:53.595485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7223): Terminated: ok {rc=0} 01:32:53.640226 --- ParallelTerminationStrategy: PID 7226 died... 01:32:53.658979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7226): Terminated: ok {rc=0} 01:32:53.742811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:32:54.830600 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:54.843012 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:32:54.917478 tst ping_idle_ping.py: using LAC 18141 01:32:55.044532 tst ping_idle_ping.py: using RAC 36 01:32:55.173627 tst ping_idle_ping.py: using CellId 18141 01:32:55.298875 tst ping_idle_ping.py: using BVCI 18142 01:32:55.415826 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:55.427320 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:55.438547 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:55.449810 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:55.460890 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:55.472280 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:55.483618 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:55.494876 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:55.610291 tst ping_idle_ping.py:24: start network... 01:32:55.811055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:56.278321 run create_hlr_db(pid=7228): Launched 01:32:56.394926 bus /gobi_6: Setting Powered False 01:32:57.455416 run create_hlr_db(pid=7228): Terminated: ok {rc=0} 01:32:57.895785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7230): Launched 01:32:58.216925 run osmo-hlr_10.42.42.2(pid=7231): Launched 01:32:58.339158 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:58.896810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7233): Launched 01:32:59.217666 run osmo-stp_10.42.42.5(pid=7234): Launched 01:32:59.340680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:59.897667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7236): Launched 01:33:00.020633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:33:00.292469 run patchelf(pid=7237): Launched 01:33:00.470764 run osmo-stp_10.42.42.5(pid=7234): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7234)] 01:33:00.606469 run osmo-stp_10.42.42.5(pid=7234): stdout: | (launched: 2022-12-09_01:32:59.158526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:00.744073 run osmo-stp_10.42.42.5(pid=7234): stderr: | 20221209013259350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013259350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013259351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013259351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013259351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013259351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013259352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:00.921699 run osmo-stp_10.42.42.5(pid=7234): stdout: | (launched: 2022-12-09_01:32:59.158526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:01.056617 run osmo-stp_10.42.42.5(pid=7234): stderr: | 20221209013259350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013259350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013259351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013259351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013259351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013259351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013259352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:01.233187 run patchelf(pid=7237): Terminating (SIGINT) 01:33:01.416548 run patchelf(pid=7237): Terminated: ok {rc=0} 01:33:01.548599 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7234): Process ended prematurely: osmo-stp_10.42.42.5(pid=7234) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7234)] [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:33:01.558685 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:33:01.588023 run osmo-hlr_10.42.42.2(pid=7231): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7231)] 01:33:01.639640 run osmo-hlr_10.42.42.2(pid=7231): stdout: | (launched: 2022-12-09_01:32:58.157982) 01:33:01.694904 run osmo-hlr_10.42.42.2(pid=7231): stderr: | 20221209013258357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013258357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013258357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013258357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013258357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013258357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013258369 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013258378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013258378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013258378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:01.749490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7230): Terminating (SIGTERM) 01:33:01.793499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7233): Terminating (SIGTERM) 01:33:01.839017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7236): Terminating (SIGTERM) 01:33:01.884799 --- ParallelTerminationStrategy: PID 7230 died... 01:33:01.905868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7230): Terminated: ok {rc=0} 01:33:01.953479 --- ParallelTerminationStrategy: PID 7233 died... 01:33:01.973913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7233): Terminated: ok {rc=0} 01:33:02.021480 --- ParallelTerminationStrategy: PID 7236 died... 01:33:02.041589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7236): Terminated: ok {rc=0} 01:33:02.132380 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:33:03.441730 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:03.449277 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:33:03.482917 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:33:03.518254 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:33:03.573775 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:33:03.608293 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:33:03.642805 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:33:04.200448 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:33:04.206182 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:33:04.217984 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:33:04.289229 tst switch_tch_pdch.py: using LAC 18142 01:33:04.414495 tst switch_tch_pdch.py: using RAC 37 01:33:04.541170 tst switch_tch_pdch.py: using CellId 18142 01:33:04.665857 tst switch_tch_pdch.py: using BVCI 18143 01:33:04.776380 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:33:04.787706 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:33:04.798826 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:33:04.810710 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:33:04.822631 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:33:04.834530 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:33:04.846500 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:33:04.858347 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:33:04.980128 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:33:05.100353 tst switch_tch_pdch.py:51: start network... 01:33:05.302061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:05.764777 run create_hlr_db(pid=7243): Launched 01:33:05.879390 bus /gobi_6: Setting Powered False 01:33:06.938466 run create_hlr_db(pid=7243): Terminated: ok {rc=0} 01:33:07.376358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7245): Launched 01:33:07.698042 run osmo-hlr_10.42.42.2(pid=7246): Launched 01:33:07.820559 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:08.370968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7248): Launched 01:33:08.691846 run osmo-stp_10.42.42.5(pid=7249): Launched 01:33:08.818931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:33:09.370491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7251): Launched 01:33:09.493436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:33:09.763592 run patchelf(pid=7252): Launched 01:33:09.941657 run osmo-stp_10.42.42.5(pid=7249): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7249)] 01:33:10.076750 run osmo-stp_10.42.42.5(pid=7249): stdout: | (launched: 2022-12-09_01:33:08.632596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:10.213560 run osmo-stp_10.42.42.5(pid=7249): stderr: | 20221209013308824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013308824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013308824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013308824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013308825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013308825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013308825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:10.350127 run osmo-stp_10.42.42.5(pid=7249): stdout: | (launched: 2022-12-09_01:33:08.632596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:10.480698 run osmo-stp_10.42.42.5(pid=7249): stderr: | 20221209013308824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013308824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013308824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013308824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013308825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013308825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013308825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:10.635237 run patchelf(pid=7252): Terminating (SIGINT) 01:33:10.814491 run patchelf(pid=7252): Terminated: ok {rc=0} 01:33:10.942858 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7249): Process ended prematurely: osmo-stp_10.42.42.5(pid=7249) [trial-2352↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7249)] [trial-2352↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:33:10.952322 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 01:33:10.980293 run osmo-hlr_10.42.42.2(pid=7246): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7246)] 01:33:11.030440 run osmo-hlr_10.42.42.2(pid=7246): stdout: | (launched: 2022-12-09_01:33:07.639209) 01:33:11.082454 run osmo-hlr_10.42.42.2(pid=7246): stderr: | 20221209013307836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013307836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013307836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013307836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013307836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013307836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013307848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013307856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013307856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013307857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:11.134341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7245): Terminating (SIGTERM) 01:33:11.175821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7248): Terminating (SIGTERM) 01:33:11.217918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7251): Terminating (SIGTERM) 01:33:11.259752 --- ParallelTerminationStrategy: PID 7245 died... 01:33:11.279880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7245): Terminated: ok {rc=0} 01:33:11.326663 --- ParallelTerminationStrategy: PID 7248 died... 01:33:11.346357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7248): Terminated: ok {rc=0} 01:33:11.392646 --- ParallelTerminationStrategy: PID 7251 died... 01:33:11.412446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7251): Terminated: ok {rc=0} 01:33:11.500453 bus /gobi_0: Setting Powered False 01:33:12.599344 bus /gobi_0: Setting Powered False 01:33:13.714587 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:33:14.971433 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:14.977654 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:33:15.011496 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:33:15.046871 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:33:15.101388 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:33:15.135360 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:33:15.170555 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:33:15.722593 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:33:15.728075 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:33:15.739122 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:33:15.808913 tst switch_tch_pdch.py: using LAC 18143 01:33:15.964684 tst switch_tch_pdch.py: using RAC 38 01:33:16.135979 tst switch_tch_pdch.py: using CellId 18143 01:33:16.260315 tst switch_tch_pdch.py: using BVCI 18144 01:33:16.418237 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:33:16.431164 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:33:16.442941 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:33:16.455297 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:33:16.466806 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:33:16.479560 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:33:16.491246 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:33:16.503011 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:33:16.624228 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:33:16.753762 tst switch_tch_pdch.py:51: start network... 01:33:17.022135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:17.502109 run create_hlr_db(pid=7256): Launched 01:33:17.618393 bus /gobi_6: Setting Powered False 01:33:18.679036 run create_hlr_db(pid=7256): Terminated: ok {rc=0} 01:33:19.071739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7258): Launched 01:33:19.371580 run osmo-hlr_10.42.42.2(pid=7259): Launched 01:33:19.485380 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:19.990532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7261): Launched 01:33:20.289383 run osmo-stp_10.42.42.5(pid=7262): Launched 01:33:20.404763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:33:20.896323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7264): Launched 01:33:21.011196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:33:21.263584 run patchelf(pid=7265): Launched 01:33:21.429835 run osmo-stp_10.42.42.5(pid=7262): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7262)] 01:33:21.556461 run osmo-stp_10.42.42.5(pid=7262): stdout: | (launched: 2022-12-09_01:33:20.233889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:21.684880 run osmo-stp_10.42.42.5(pid=7262): stderr: | 20221209013320402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013320402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013320403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013320403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013320404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013320404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013320404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:21.813441 run osmo-stp_10.42.42.5(pid=7262): stdout: | (launched: 2022-12-09_01:33:20.233889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:21.935931 run osmo-stp_10.42.42.5(pid=7262): stderr: | 20221209013320402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013320402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013320403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013320403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013320404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013320404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013320404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:22.080609 run patchelf(pid=7265): Terminating (SIGINT) 01:33:22.249486 run patchelf(pid=7265): Terminated: ok {rc=0} 01:33:22.371114 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7262): Process ended prematurely: osmo-stp_10.42.42.5(pid=7262) [trial-2352↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7262)] [trial-2352↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:33:22.380038 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 01:33:22.407292 run osmo-hlr_10.42.42.2(pid=7259): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7259)] 01:33:22.455400 run osmo-hlr_10.42.42.2(pid=7259): stdout: | (launched: 2022-12-09_01:33:19.316133) 01:33:22.505269 run osmo-hlr_10.42.42.2(pid=7259): stderr: | 20221209013319493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013319493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013319493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013319493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013319493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013319493 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013319507 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013319516 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013319516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013319516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:22.555641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7258): Terminating (SIGTERM) 01:33:22.595756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7261): Terminating (SIGTERM) 01:33:22.635731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7264): Terminating (SIGTERM) 01:33:22.675873 --- ParallelTerminationStrategy: PID 7258 died... 01:33:22.695017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7258): Terminated: ok {rc=0} 01:33:22.739919 --- ParallelTerminationStrategy: PID 7261 died... 01:33:22.758620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7261): Terminated: ok {rc=0} 01:33:22.803208 --- ParallelTerminationStrategy: PID 7264 died... 01:33:22.822039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7264): Terminated: ok {rc=0} 01:33:22.908368 bus /gobi_0: Setting Powered False 01:33:24.008521 bus /gobi_0: Setting Powered False 01:33:25.126451 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 01:33:26.374976 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:26.378946 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:33:26.409179 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 01:33:26.416933 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 01:33:26.469301 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:33:26.498912 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 01:33:26.505764 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 01:33:27.043832 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 01:33:27.049035 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 01:33:27.059784 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:33:27.107779 tst mo_mt_sms.py: using LAC 18144 01:33:27.228222 tst mo_mt_sms.py: using RAC 39 01:33:27.345567 tst mo_mt_sms.py: using CellId 18144 01:33:27.460890 tst mo_mt_sms.py: using BVCI 18145 01:33:27.569112 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:33:27.687664 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:33:27.800680 tst mo_mt_sms.py:9: start nitb and bts... 01:33:28.002321 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:33:28.611894 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7269): Launched 01:33:28.911059 run osmo-nitb_10.42.42.2(pid=7270): Launched 01:33:29.077250 run osmo-nitb_10.42.42.2(pid=7270): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7270)] 01:33:29.211135 run osmo-nitb_10.42.42.2(pid=7270): stdout: | (launched: 2022-12-09_01:33:28.855837) 01:33:29.346451 run osmo-nitb_10.42.42.2(pid=7270): stderr: | (launched: 2022-12-09_01:33:28.899964) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:33:29.481750 run osmo-nitb_10.42.42.2(pid=7270): stdout: | (launched: 2022-12-09_01:33:28.855837) 01:33:29.611631 run osmo-nitb_10.42.42.2(pid=7270): stderr: | (launched: 2022-12-09_01:33:28.899964) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7270): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7270) [trial-2352↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7270)] 01:33:30.023996 tst osmo-nitb_10.42.42.2(pid=7270): stdout: | (launched: 2022-12-09_01:33:28.855837) 01:33:30.144757 tst osmo-nitb_10.42.42.2(pid=7270): stderr: | (launched: 2022-12-09_01:33:28.899964) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:33:30.287235 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=7270): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7270) [trial-2352↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7270)] [trial-2352↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 01:33:30.295501 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 01:33:30.302109 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7269): Terminating (SIGTERM) 01:33:30.512878 --- ParallelTerminationStrategy: PID 7269 died... 01:33:30.533372 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7269): Terminated: ok {rc=0} 01:33:30.619170 bus /sierra_3: Setting Powered False 01:33:31.719327 bus /sierra_3: Setting Powered False 01:33:32.841529 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 01:33:34.034695 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:34.038682 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:33:34.068245 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:33:34.094891 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 01:33:34.148498 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:33:34.179316 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:33:34.207556 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 01:33:34.748771 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 01:33:34.754640 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:34.765931 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:33:34.810609 tst mo_mt_sms.py: using LAC 18145 01:33:34.929352 tst mo_mt_sms.py: using RAC 40 01:33:35.045961 tst mo_mt_sms.py: using CellId 18145 01:33:35.162639 tst mo_mt_sms.py: using BVCI 18146 01:33:35.272437 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:35.283204 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:35.293823 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:35.304568 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:35.315377 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:35.326192 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:33:35.443709 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:33:35.562654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:36.060820 run create_hlr_db(pid=7274): Launched 01:33:36.190835 bus /sierra_2: Setting Powered False 01:33:37.254090 run create_hlr_db(pid=7274): Terminated: ok {rc=0} 01:33:37.684617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7276): Launched 01:33:37.984744 run osmo-hlr_10.42.42.2(pid=7277): Launched 01:33:38.099859 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:38.631445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7279): Launched 01:33:38.930289 run osmo-stp_10.42.42.5(pid=7280): Launched 01:33:39.043781 run osmo-msc_10.42.42.6: Starting osmo-msc 01:33:39.587832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7282): Launched 01:33:39.888641 run osmo-msc_10.42.42.6(pid=7283): Launched 01:33:40.057994 run osmo-stp_10.42.42.5(pid=7280): ERR: Terminated: ERROR {rc=1} [trial-2352↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7280)] 01:33:40.185404 run osmo-stp_10.42.42.5(pid=7280): stdout: | (launched: 2022-12-09_01:33:38.874786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:40.312495 run osmo-stp_10.42.42.5(pid=7280): stderr: | 20221209013339044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013339044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013339044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013339045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013339045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013339045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013339045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:40.437371 run osmo-stp_10.42.42.5(pid=7280): stdout: | (launched: 2022-12-09_01:33:38.874786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:40.556423 run osmo-stp_10.42.42.5(pid=7280): stderr: | 20221209013339044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013339044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013339044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013339045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013339045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013339045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013339045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:40.698794 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7280): Process ended prematurely: osmo-stp_10.42.42.5(pid=7280) [trial-2352↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7280)] [trial-2352↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 01:33:40.707125 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 01:33:40.734185 run osmo-hlr_10.42.42.2(pid=7277): ERR: Terminated: ERROR {rc=237} [trial-2352↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7277)] 01:33:40.783176 run osmo-hlr_10.42.42.2(pid=7277): stdout: | (launched: 2022-12-09_01:33:37.929231) 01:33:40.833616 run osmo-hlr_10.42.42.2(pid=7277): stderr: | 20221209013338104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013338104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013338104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013338105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013338105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013338105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013338117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013338125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013338125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013338126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:40.903540 run osmo-msc_10.42.42.6(pid=7283): ERR: Terminated: ERROR {rc=2} [trial-2352↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7283)] 01:33:40.952535 run osmo-msc_10.42.42.6(pid=7283): stdout: | (launched: 2022-12-09_01:33:39.833465) 01:33:41.002721 run osmo-msc_10.42.42.6(pid=7283): stderr: | 20221209013340105 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013340105 DLGLOBAL DEBUG validating counter group 0x7f1f36ee5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013340105 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013340105 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013340105 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013340105 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013340107 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013340107 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013340108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013340108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:33:41.053373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7276): Terminating (SIGTERM) 01:33:41.093826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7279): Terminating (SIGTERM) 01:33:41.134255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7282): Terminating (SIGTERM) 01:33:41.175034 --- ParallelTerminationStrategy: PID 7276 died... 01:33:41.194470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7276): Terminated: ok {rc=0} 01:33:41.239514 --- ParallelTerminationStrategy: PID 7279 died... 01:33:41.258431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7279): Terminated: ok {rc=0} 01:33:41.303088 --- ParallelTerminationStrategy: PID 7282 died... 01:33:41.322307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7282): Terminated: ok {rc=0} 01:33:41.407439 bus /sierra_3: Setting Powered False 01:33:42.507225 bus /sierra_3: Setting Powered False 01:33:43.624614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 01:33:44.849591 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:44.853330 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:33:44.883247 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 01:33:44.890537 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 01:33:44.926707 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:33:44.955990 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 01:33:44.963242 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 01:33:45.480085 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2352 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 01:33:45.485499 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 01:33:45.496412 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:33:45.545217 tst assert_extension.py: using LAC 18146 01:33:45.660476 tst assert_extension.py: using RAC 41 01:33:45.776538 tst assert_extension.py: using CellId 18146 01:33:45.929817 tst assert_extension.py: using BVCI 18147 01:33:46.049414 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 01:33:46.170488 tst assert_extension.py:10: start nitb and bts... 01:33:46.377788 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:33:47.037144 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7288): Launched 01:33:47.370486 run osmo-nitb_10.42.42.2(pid=7289): Launched 01:33:47.548416 run osmo-nitb_10.42.42.2(pid=7289): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7289)] 01:33:47.692576 run osmo-nitb_10.42.42.2(pid=7289): stdout: | (launched: 2022-12-09_01:33:47.311817) 01:33:47.839084 run osmo-nitb_10.42.42.2(pid=7289): stderr: | (launched: 2022-12-09_01:33:47.359506) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:33:47.984374 run osmo-nitb_10.42.42.2(pid=7289): stdout: | (launched: 2022-12-09_01:33:47.311817) 01:33:48.123611 run osmo-nitb_10.42.42.2(pid=7289): stderr: | (launched: 2022-12-09_01:33:47.359506) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7289): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7289) [trial-2352↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7289)] 01:33:48.491782 tst osmo-nitb_10.42.42.2(pid=7289): stdout: | (launched: 2022-12-09_01:33:47.311817) 01:33:48.621078 tst osmo-nitb_10.42.42.2(pid=7289): stderr: | (launched: 2022-12-09_01:33:47.359506) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:33:48.773830 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7289): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7289) [trial-2352↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7289)] [trial-2352↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 01:33:48.782774 tst assert_extension.py:12: Test FAILED (3.3 sec) 01:33:48.789895 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7288): Terminating (SIGTERM) 01:33:49.001039 --- ParallelTerminationStrategy: PID 7288 died... 01:33:49.022565 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7288): Terminated: ok {rc=0} 01:33:49.111336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 01:33:50.284349 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:50.288564 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:33:50.318426 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:33:50.345963 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 01:33:50.381880 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:33:50.411588 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:33:50.438814 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 01:33:50.966064 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2352 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 01:33:50.971267 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:50.982150 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:33:51.026682 tst assert_extension.py: using LAC 18147 01:33:51.146698 tst assert_extension.py: using RAC 42 01:33:51.263217 tst assert_extension.py: using CellId 18147 01:33:51.382462 tst assert_extension.py: using BVCI 18148 01:33:51.492591 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:51.503371 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:51.513939 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:51.525051 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:51.535804 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:51.546712 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 01:33:51.663043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:52.128465 run create_hlr_db(pid=7293): Launched 01:33:52.243082 bus /sierra_2: Setting Powered False 01:33:53.302856 run create_hlr_db(pid=7293): Terminated: ok {rc=0} 01:33:53.722773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7295): Launched 01:33:54.023351 run osmo-hlr_10.42.42.2(pid=7296): Launched 01:33:54.138049 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:54.670169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7298): Launched 01:33:54.969685 run osmo-stp_10.42.42.5(pid=7299): Launched 01:33:55.084329 run osmo-msc_10.42.42.6: Starting osmo-msc 01:33:55.623575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7301): Launched 01:33:55.922752 run osmo-msc_10.42.42.6(pid=7302): Launched 01:33:56.089159 run osmo-stp_10.42.42.5(pid=7299): ERR: Terminated: ERROR {rc=1} [trial-2352↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7299)] 01:33:56.222385 run osmo-stp_10.42.42.5(pid=7299): stdout: | (launched: 2022-12-09_01:33:54.914302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:56.360279 run osmo-stp_10.42.42.5(pid=7299): stderr: | 20221209013355084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013355084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013355084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013355085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013355085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013355085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013355085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:56.494468 run osmo-stp_10.42.42.5(pid=7299): stdout: | (launched: 2022-12-09_01:33:54.914302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:56.622026 run osmo-stp_10.42.42.5(pid=7299): stderr: | 20221209013355084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013355084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013355084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013355085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013355085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013355085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013355085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:56.779875 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7299): Process ended prematurely: osmo-stp_10.42.42.5(pid=7299) [trial-2352↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7299)] [trial-2352↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 01:33:56.788586 tst assert_extension.py:17: Test FAILED (5.8 sec) 01:33:56.816892 run osmo-hlr_10.42.42.2(pid=7296): ERR: Terminated: ERROR {rc=237} [trial-2352↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7296)] 01:33:56.867449 run osmo-hlr_10.42.42.2(pid=7296): stdout: | (launched: 2022-12-09_01:33:53.967785) 01:33:56.920163 run osmo-hlr_10.42.42.2(pid=7296): stderr: | 20221209013354143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013354143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013354143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013354143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013354143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013354144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013354155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013354165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013354165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013354165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:56.992779 run osmo-msc_10.42.42.6(pid=7302): ERR: Terminated: ERROR {rc=2} [trial-2352↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7302)] 01:33:57.043212 run osmo-msc_10.42.42.6(pid=7302): stdout: | (launched: 2022-12-09_01:33:55.867530) 01:33:57.095449 run osmo-msc_10.42.42.6(pid=7302): stderr: | 20221209013356137 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013356138 DLGLOBAL DEBUG validating counter group 0x7faef56fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013356138 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013356138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013356139 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013356139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013356141 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013356141 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013356141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013356141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:33:57.148229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7295): Terminating (SIGTERM) 01:33:57.190742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7298): Terminating (SIGTERM) 01:33:57.232744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7301): Terminating (SIGTERM) 01:33:57.275429 --- ParallelTerminationStrategy: PID 7295 died... 01:33:57.295516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7295): Terminated: ok {rc=0} 01:33:57.343155 --- ParallelTerminationStrategy: PID 7298 died... 01:33:57.362968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7298): Terminated: ok {rc=0} 01:33:57.410758 --- ParallelTerminationStrategy: PID 7301 died... 01:33:57.430584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7301): Terminated: ok {rc=0} 01:33:57.519591 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:33:58.730349 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:58.737826 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:33:58.767865 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:33:58.795228 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:33:58.847949 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:33:58.877675 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:33:58.904902 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:33:59.458746 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:33:59.511434 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:59.523271 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:33:59.590863 tst mo_mt_call.py: using LAC 18148 01:33:59.719691 tst mo_mt_call.py: using RAC 43 01:33:59.847919 tst mo_mt_call.py: using CellId 18148 01:33:59.974891 tst mo_mt_call.py: using BVCI 18149 01:34:00.094562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:34:00.106434 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:34:00.118063 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:34:00.129728 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:34:00.141354 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:34:00.153029 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:34:00.267755 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:34:00.387121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:00.897433 run create_hlr_db(pid=7307): Launched 01:34:01.048528 bus /sierra_2: Setting Powered False 01:34:02.134954 run create_hlr_db(pid=7307): Terminated: ok {rc=0} 01:34:02.603744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7309): Launched 01:34:02.931567 run osmo-hlr_10.42.42.2(pid=7310): Launched 01:34:03.055482 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:03.622103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7312): Launched 01:34:03.950089 run osmo-stp_10.42.42.5(pid=7313): Launched 01:34:04.074808 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:04.665779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7315): Launched 01:34:04.993935 run osmo-msc_10.42.42.6(pid=7316): Launched 01:34:05.175983 run osmo-stp_10.42.42.5(pid=7313): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7313)] 01:34:05.313112 run osmo-stp_10.42.42.5(pid=7313): stdout: | (launched: 2022-12-09_01:34:03.890595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:05.450588 run osmo-stp_10.42.42.5(pid=7313): stderr: | 20221209013404082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013404082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013404082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013404083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013404083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013404083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013404083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:05.586761 run osmo-stp_10.42.42.5(pid=7313): stdout: | (launched: 2022-12-09_01:34:03.890595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:05.716162 run osmo-stp_10.42.42.5(pid=7313): stderr: | 20221209013404082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013404082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013404082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013404083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013404083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013404083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013404083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:05.872213 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7313): Process ended prematurely: osmo-stp_10.42.42.5(pid=7313) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7313)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:34:05.881964 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:34:05.909864 run osmo-hlr_10.42.42.2(pid=7310): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7310)] 01:34:05.959539 run osmo-hlr_10.42.42.2(pid=7310): stdout: | (launched: 2022-12-09_01:34:02.872373) 01:34:06.010933 run osmo-hlr_10.42.42.2(pid=7310): stderr: | 20221209013403068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013403068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013403068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013403068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013403068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013403068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013403081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013403089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013403089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013403090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:06.082952 run osmo-msc_10.42.42.6(pid=7316): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7316)] 01:34:06.132656 run osmo-msc_10.42.42.6(pid=7316): stdout: | (launched: 2022-12-09_01:34:04.934344) 01:34:06.184131 run osmo-msc_10.42.42.6(pid=7316): stderr: | 20221209013405256 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013405256 DLGLOBAL DEBUG validating counter group 0x7fc200186c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013405256 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013405257 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013405257 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013405257 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013405259 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013405259 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013405259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013405259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:06.235899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7309): Terminating (SIGTERM) 01:34:06.277747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7312): Terminating (SIGTERM) 01:34:06.319371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7315): Terminating (SIGTERM) 01:34:06.361255 --- ParallelTerminationStrategy: PID 7309 died... 01:34:06.380942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7309): Terminated: ok {rc=0} 01:34:06.427240 --- ParallelTerminationStrategy: PID 7312 died... 01:34:06.446793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7312): Terminated: ok {rc=0} 01:34:06.492693 --- ParallelTerminationStrategy: PID 7315 died... 01:34:06.512219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7315): Terminated: ok {rc=0} 01:34:06.600543 bus /sierra_3: Setting Powered False 01:34:07.699112 bus /sierra_3: Setting Powered False 01:34:08.814522 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:34:09.959662 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:34:09.971877 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:34:10.038155 tst mo_mt_call_osmux.py: using LAC 18149 01:34:10.159397 tst mo_mt_call_osmux.py: using RAC 44 01:34:10.281994 tst mo_mt_call_osmux.py: using CellId 18149 01:34:10.399640 tst mo_mt_call_osmux.py: using BVCI 18150 01:34:10.509887 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:34:10.521129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:34:10.532187 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:34:10.543499 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:34:10.554825 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:34:10.566183 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:34:10.685651 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:34:10.803824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:11.274083 run create_hlr_db(pid=7318): Launched 01:34:11.390744 bus /sierra_2: Setting Powered False 01:34:12.451466 run create_hlr_db(pid=7318): Terminated: ok {rc=0} 01:34:12.876201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7320): Launched 01:34:13.181699 run osmo-hlr_10.42.42.2(pid=7321): Launched 01:34:13.298165 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:13.819716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7323): Launched 01:34:14.124136 run osmo-stp_10.42.42.5(pid=7324): Launched 01:34:14.240861 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:14.792540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7326): Launched 01:34:15.097053 run osmo-msc_10.42.42.6(pid=7327): Launched 01:34:15.268232 run osmo-stp_10.42.42.5(pid=7324): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7324)] 01:34:15.397632 run osmo-stp_10.42.42.5(pid=7324): stdout: | (launched: 2022-12-09_01:34:14.068150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:15.526639 run osmo-stp_10.42.42.5(pid=7324): stderr: | 20221209013414236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013414236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013414236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013414237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013414237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013414237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013414237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:15.652762 run osmo-stp_10.42.42.5(pid=7324): stdout: | (launched: 2022-12-09_01:34:14.068150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:15.773415 run osmo-stp_10.42.42.5(pid=7324): stderr: | 20221209013414236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013414236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013414236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013414237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013414237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013414237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013414237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:15.924381 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7324): Process ended prematurely: osmo-stp_10.42.42.5(pid=7324) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7324)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:34:15.934341 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 01:34:15.963621 run osmo-hlr_10.42.42.2(pid=7321): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7321)] 01:34:16.013066 run osmo-hlr_10.42.42.2(pid=7321): stdout: | (launched: 2022-12-09_01:34:13.125190) 01:34:16.064324 run osmo-hlr_10.42.42.2(pid=7321): stderr: | 20221209013413300 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013413300 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013413300 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013413300 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013413301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013413301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013413312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013413320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013413321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013413321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:16.136059 run osmo-msc_10.42.42.6(pid=7327): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7327)] 01:34:16.186313 run osmo-msc_10.42.42.6(pid=7327): stdout: | (launched: 2022-12-09_01:34:15.040856) 01:34:16.238072 run osmo-msc_10.42.42.6(pid=7327): stderr: | 20221209013415312 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013415312 DLGLOBAL DEBUG validating counter group 0x7f8a6c73ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013415313 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013415313 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013415313 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013415313 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013415315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013415315 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013415315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013415315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:16.290449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7320): Terminating (SIGTERM) 01:34:16.333159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7323): Terminating (SIGTERM) 01:34:16.376853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7326): Terminating (SIGTERM) 01:34:16.419392 --- ParallelTerminationStrategy: PID 7320 died... 01:34:16.439197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7320): Terminated: ok {rc=0} 01:34:16.486872 --- ParallelTerminationStrategy: PID 7323 died... 01:34:16.506557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7323): Terminated: ok {rc=0} 01:34:16.553713 --- ParallelTerminationStrategy: PID 7326 died... 01:34:16.573393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7326): Terminated: ok {rc=0} 01:34:16.664170 bus /sierra_3: Setting Powered False 01:34:17.764607 bus /sierra_3: Setting Powered False 01:34:18.876442 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:34:20.125661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:34:20.132650 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:34:20.162843 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:34:20.190230 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:34:20.243080 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:34:20.273149 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:34:20.300678 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:34:20.855223 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:34:20.907655 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:20.919581 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:34:20.987853 tst mo_mt_call.py: using LAC 18150 01:34:21.115179 tst mo_mt_call.py: using RAC 45 01:34:21.243260 tst mo_mt_call.py: using CellId 18150 01:34:21.372876 tst mo_mt_call.py: using BVCI 18151 01:34:21.492486 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:21.504178 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:21.515591 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:21.527315 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:21.539134 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:21.550811 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:34:21.667454 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:34:21.783198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:22.255506 run create_hlr_db(pid=7332): Launched 01:34:22.372056 bus /sierra_2: Setting Powered False 01:34:23.432369 run create_hlr_db(pid=7332): Terminated: ok {rc=0} 01:34:23.877101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7334): Launched 01:34:24.203983 run osmo-hlr_10.42.42.2(pid=7335): Launched 01:34:24.328303 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:24.889235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7337): Launched 01:34:25.215760 run osmo-stp_10.42.42.5(pid=7338): Launched 01:34:25.339856 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:25.929677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7340): Launched 01:34:26.257693 run osmo-msc_10.42.42.6(pid=7341): Launched 01:34:26.439307 run osmo-stp_10.42.42.5(pid=7338): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7338)] 01:34:26.576030 run osmo-stp_10.42.42.5(pid=7338): stdout: | (launched: 2022-12-09_01:34:25.156169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:26.713320 run osmo-stp_10.42.42.5(pid=7338): stderr: | 20221209013425347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013425347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013425347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013425348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013425348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013425348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013425348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:26.850228 run osmo-stp_10.42.42.5(pid=7338): stdout: | (launched: 2022-12-09_01:34:25.156169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:26.980063 run osmo-stp_10.42.42.5(pid=7338): stderr: | 20221209013425347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013425347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013425347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013425348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013425348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013425348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013425348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:27.135902 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7338): Process ended prematurely: osmo-stp_10.42.42.5(pid=7338) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7338)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:34:27.145562 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:34:27.173465 run osmo-hlr_10.42.42.2(pid=7335): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7335)] 01:34:27.223632 run osmo-hlr_10.42.42.2(pid=7335): stdout: | (launched: 2022-12-09_01:34:24.144374) 01:34:27.275539 run osmo-hlr_10.42.42.2(pid=7335): stderr: | 20221209013424343 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013424343 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013424343 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013424343 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013424343 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013424343 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013424356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013424364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013424364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013424364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:27.348099 run osmo-msc_10.42.42.6(pid=7341): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7341)] 01:34:27.397965 run osmo-msc_10.42.42.6(pid=7341): stdout: | (launched: 2022-12-09_01:34:26.198009) 01:34:27.449654 run osmo-msc_10.42.42.6(pid=7341): stderr: | 20221209013426520 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013426521 DLGLOBAL DEBUG validating counter group 0x7feac5a4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013426521 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013426521 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013426521 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013426521 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013426523 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013426523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013426524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013426524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:27.501861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7334): Terminating (SIGTERM) 01:34:27.543448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7337): Terminating (SIGTERM) 01:34:27.585218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7340): Terminating (SIGTERM) 01:34:27.627327 --- ParallelTerminationStrategy: PID 7334 died... 01:34:27.647497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7334): Terminated: ok {rc=0} 01:34:27.694284 --- ParallelTerminationStrategy: PID 7337 died... 01:34:27.714020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7337): Terminated: ok {rc=0} 01:34:27.760810 --- ParallelTerminationStrategy: PID 7340 died... 01:34:27.781084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7340): Terminated: ok {rc=0} 01:34:27.868639 bus /sierra_3: Setting Powered False 01:34:28.968991 bus /sierra_3: Setting Powered False 01:34:30.086738 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:34:31.255528 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:31.270206 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:34:31.340246 tst mo_mt_call_osmux.py: using LAC 18151 01:34:31.517621 tst mo_mt_call_osmux.py: using RAC 46 01:34:31.642728 tst mo_mt_call_osmux.py: using CellId 18151 01:34:31.791686 tst mo_mt_call_osmux.py: using BVCI 18152 01:34:31.916812 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:31.929561 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:31.941876 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:31.954182 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:31.966625 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:31.979229 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:34:32.106695 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:34:32.234384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:32.739802 run create_hlr_db(pid=7343): Launched 01:34:32.872731 bus /sierra_2: Setting Powered False 01:34:33.933579 run create_hlr_db(pid=7343): Terminated: ok {rc=0} 01:34:34.389576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7345): Launched 01:34:34.716694 run osmo-hlr_10.42.42.2(pid=7346): Launched 01:34:34.841007 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:35.403587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7348): Launched 01:34:35.729140 run osmo-stp_10.42.42.5(pid=7349): Launched 01:34:35.855251 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:36.445154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7351): Launched 01:34:36.770845 run osmo-msc_10.42.42.6(pid=7352): Launched 01:34:36.952006 run osmo-stp_10.42.42.5(pid=7349): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7349)] 01:34:37.089092 run osmo-stp_10.42.42.5(pid=7349): stdout: | (launched: 2022-12-09_01:34:35.669693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:37.226262 run osmo-stp_10.42.42.5(pid=7349): stderr: | 20221209013435862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013435862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013435862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013435863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013435863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013435863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013435863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:37.361938 run osmo-stp_10.42.42.5(pid=7349): stdout: | (launched: 2022-12-09_01:34:35.669693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:37.491560 run osmo-stp_10.42.42.5(pid=7349): stderr: | 20221209013435862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013435862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013435862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013435863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013435863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013435863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013435863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:37.646406 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7349): Process ended prematurely: osmo-stp_10.42.42.5(pid=7349) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7349)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:34:37.656063 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:34:37.684292 run osmo-hlr_10.42.42.2(pid=7346): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7346)] 01:34:37.734479 run osmo-hlr_10.42.42.2(pid=7346): stdout: | (launched: 2022-12-09_01:34:34.657242) 01:34:37.787121 run osmo-hlr_10.42.42.2(pid=7346): stderr: | 20221209013434854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013434854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013434854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013434854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013434854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013434854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013434866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013434875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013434875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013434875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:37.859730 run osmo-msc_10.42.42.6(pid=7352): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7352)] 01:34:37.909609 run osmo-msc_10.42.42.6(pid=7352): stdout: | (launched: 2022-12-09_01:34:36.711017) 01:34:37.961403 run osmo-msc_10.42.42.6(pid=7352): stderr: | 20221209013437031 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013437031 DLGLOBAL DEBUG validating counter group 0x7f34f03a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013437031 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013437031 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013437031 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013437031 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013437033 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013437033 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013437034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013437034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:38.013536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7345): Terminating (SIGTERM) 01:34:38.054933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7348): Terminating (SIGTERM) 01:34:38.096858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7351): Terminating (SIGTERM) 01:34:38.139225 --- ParallelTerminationStrategy: PID 7345 died... 01:34:38.158923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7345): Terminated: ok {rc=0} 01:34:38.205461 --- ParallelTerminationStrategy: PID 7348 died... 01:34:38.225281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7348): Terminated: ok {rc=0} 01:34:38.271407 --- ParallelTerminationStrategy: PID 7351 died... 01:34:38.291161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7351): Terminated: ok {rc=0} 01:34:38.378863 bus /sierra_3: Setting Powered False 01:34:39.478416 bus /sierra_3: Setting Powered False 01:34:40.594033 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:34:41.840484 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:34:41.847529 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:34:41.877564 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:34:41.905285 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:34:41.957569 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:34:41.987036 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:34:42.013786 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:34:42.568844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:34:42.621392 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:42.633183 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:34:42.698953 tst mo_mt_call.py: using LAC 18152 01:34:42.825188 tst mo_mt_call.py: using RAC 47 01:34:42.950868 tst mo_mt_call.py: using CellId 18152 01:34:43.076656 tst mo_mt_call.py: using BVCI 18153 01:34:43.194492 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:43.206280 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:43.217844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:43.229379 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:43.240893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:43.252778 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:43.368331 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:43.483599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:43.987385 run create_hlr_db(pid=7357): Launched 01:34:44.119474 bus /sierra_2: Setting Powered False 01:34:45.184263 run create_hlr_db(pid=7357): Terminated: ok {rc=0} 01:34:45.618667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7360): Launched 01:34:45.945746 run osmo-hlr_10.42.42.2(pid=7361): Launched 01:34:46.170455 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:46.967115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7363): Launched 01:34:47.311389 run osmo-stp_10.42.42.5(pid=7364): Launched 01:34:47.449472 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:48.005412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7366): Launched 01:34:48.311368 run osmo-msc_10.42.42.6(pid=7367): Launched 01:34:48.481570 run osmo-stp_10.42.42.5(pid=7364): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7364)] 01:34:48.610715 run osmo-stp_10.42.42.5(pid=7364): stdout: | (launched: 2022-12-09_01:34:47.249778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:48.739584 run osmo-stp_10.42.42.5(pid=7364): stderr: | 20221209013447449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013447449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013447449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013447450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013447450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013447450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013447450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:48.866855 run osmo-stp_10.42.42.5(pid=7364): stdout: | (launched: 2022-12-09_01:34:47.249778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:48.987710 run osmo-stp_10.42.42.5(pid=7364): stderr: | 20221209013447449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013447449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013447449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013447450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013447450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013447450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013447450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:49.132605 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7364): Process ended prematurely: osmo-stp_10.42.42.5(pid=7364) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7364)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:34:49.141836 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 01:34:49.169219 run osmo-hlr_10.42.42.2(pid=7361): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7361)] 01:34:49.217940 run osmo-hlr_10.42.42.2(pid=7361): stdout: | (launched: 2022-12-09_01:34:45.873677) 01:34:49.267806 run osmo-hlr_10.42.42.2(pid=7361): stderr: | 20221209013446249 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013446249 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013446250 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013446250 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013446250 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013446250 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013446278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013446296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013446297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013446297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:49.337484 run osmo-msc_10.42.42.6(pid=7367): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7367)] 01:34:49.385367 run osmo-msc_10.42.42.6(pid=7367): stdout: | (launched: 2022-12-09_01:34:48.255284) 01:34:49.435102 run osmo-msc_10.42.42.6(pid=7367): stderr: | 20221209013448525 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013448525 DLGLOBAL DEBUG validating counter group 0x7f718c7bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013448525 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013448525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013448525 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013448526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013448527 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013448528 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013448528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013448528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:49.485186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7360): Terminating (SIGTERM) 01:34:49.525144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7363): Terminating (SIGTERM) 01:34:49.565214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7366): Terminating (SIGTERM) 01:34:49.605481 --- ParallelTerminationStrategy: PID 7360 died... 01:34:49.624278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7360): Terminated: ok {rc=0} 01:34:49.668906 --- ParallelTerminationStrategy: PID 7363 died... 01:34:49.688082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7363): Terminated: ok {rc=0} 01:34:49.732783 --- ParallelTerminationStrategy: PID 7366 died... 01:34:49.751439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7366): Terminated: ok {rc=0} 01:34:49.838423 bus /sierra_3: Setting Powered False 01:34:50.938040 bus /sierra_3: Setting Powered False 01:34:52.051628 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:34:53.200316 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:53.212649 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:34:53.280814 tst mo_mt_call_osmux.py: using LAC 18153 01:34:53.408512 tst mo_mt_call_osmux.py: using RAC 48 01:34:53.537643 tst mo_mt_call_osmux.py: using CellId 18153 01:34:53.664746 tst mo_mt_call_osmux.py: using BVCI 18154 01:34:53.783129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:53.794835 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:53.806538 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:53.818108 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:53.829736 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:53.841271 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:53.959869 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:54.076456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:54.549801 run create_hlr_db(pid=7369): Launched 01:34:54.667895 bus /sierra_2: Setting Powered False 01:34:55.729367 run create_hlr_db(pid=7369): Terminated: ok {rc=0} 01:34:56.153046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7371): Launched 01:34:56.459000 run osmo-hlr_10.42.42.2(pid=7372): Launched 01:34:56.575463 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:57.113486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7374): Launched 01:34:57.419317 run osmo-stp_10.42.42.5(pid=7375): Launched 01:34:57.537637 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:58.087976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7377): Launched 01:34:58.409818 run osmo-msc_10.42.42.6(pid=7378): Launched 01:34:58.582411 run osmo-stp_10.42.42.5(pid=7375): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7375)] 01:34:58.713900 run osmo-stp_10.42.42.5(pid=7375): stdout: | (launched: 2022-12-09_01:34:57.362792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:58.844128 run osmo-stp_10.42.42.5(pid=7375): stderr: | 20221209013457531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013457531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013457531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013457531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013457532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013457532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013457532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:58.971441 run osmo-stp_10.42.42.5(pid=7375): stdout: | (launched: 2022-12-09_01:34:57.362792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:59.092546 run osmo-stp_10.42.42.5(pid=7375): stderr: | 20221209013457531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013457531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013457531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013457531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013457532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013457532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013457532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:59.238478 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7375): Process ended prematurely: osmo-stp_10.42.42.5(pid=7375) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7375)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:34:59.247418 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:34:59.274750 run osmo-hlr_10.42.42.2(pid=7372): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7372)] 01:34:59.324053 run osmo-hlr_10.42.42.2(pid=7372): stdout: | (launched: 2022-12-09_01:34:56.402734) 01:34:59.374312 run osmo-hlr_10.42.42.2(pid=7372): stderr: | 20221209013456579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013456579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013456580 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013456580 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013456580 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013456580 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013456592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013456600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013456600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013456600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:59.444127 run osmo-msc_10.42.42.6(pid=7378): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7378)] 01:34:59.492064 run osmo-msc_10.42.42.6(pid=7378): stdout: | (launched: 2022-12-09_01:34:58.354224) 01:34:59.541401 run osmo-msc_10.42.42.6(pid=7378): stderr: | 20221209013458622 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013458622 DLGLOBAL DEBUG validating counter group 0x7f6f80fecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013458622 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013458622 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013458622 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013458622 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013458624 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013458624 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013458625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013458625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:59.591349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7371): Terminating (SIGTERM) 01:34:59.630981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7374): Terminating (SIGTERM) 01:34:59.670698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7377): Terminating (SIGTERM) 01:34:59.710946 --- ParallelTerminationStrategy: PID 7371 died... 01:34:59.730090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7371): Terminated: ok {rc=0} 01:34:59.774576 --- ParallelTerminationStrategy: PID 7374 died... 01:34:59.793338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7374): Terminated: ok {rc=0} 01:34:59.837558 --- ParallelTerminationStrategy: PID 7377 died... 01:34:59.856276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7377): Terminated: ok {rc=0} 01:34:59.941636 bus /sierra_3: Setting Powered False 01:35:01.040235 bus /sierra_3: Setting Powered False 01:35:02.172360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:35:03.422878 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:35:03.429869 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:35:03.459851 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:35:03.487357 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:35:03.542858 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:35:03.573210 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:35:03.599683 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:35:04.151812 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:35:04.204517 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:04.216400 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:35:04.283643 tst mo_mt_call.py: using LAC 18154 01:35:04.411568 tst mo_mt_call.py: using RAC 49 01:35:04.542604 tst mo_mt_call.py: using CellId 18154 01:35:04.669706 tst mo_mt_call.py: using BVCI 18155 01:35:04.790177 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:04.801953 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:04.813665 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:04.825248 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:04.836865 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:04.848406 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:35:04.969757 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:35:05.086845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:05.558500 run create_hlr_db(pid=7386): Launched 01:35:05.676157 bus /sierra_2: Setting Powered False 01:35:06.737734 run create_hlr_db(pid=7386): Terminated: ok {rc=0} 01:35:07.162593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7388): Launched 01:35:07.467823 run osmo-hlr_10.42.42.2(pid=7389): Launched 01:35:07.585794 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:08.111066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7391): Launched 01:35:08.414280 run osmo-stp_10.42.42.5(pid=7392): Launched 01:35:08.530637 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:09.079635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7394): Launched 01:35:09.385460 run osmo-msc_10.42.42.6(pid=7395): Launched 01:35:09.557274 run osmo-stp_10.42.42.5(pid=7392): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7392)] 01:35:09.686561 run osmo-stp_10.42.42.5(pid=7392): stdout: | (launched: 2022-12-09_01:35:08.358233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:09.815729 run osmo-stp_10.42.42.5(pid=7392): stderr: | 20221209013508527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013508527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013508527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013508528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013508528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013508528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013508529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:09.942623 run osmo-stp_10.42.42.5(pid=7392): stdout: | (launched: 2022-12-09_01:35:08.358233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:10.063882 run osmo-stp_10.42.42.5(pid=7392): stderr: | 20221209013508527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013508527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013508527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013508528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013508528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013508528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013508529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:10.208726 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7392): Process ended prematurely: osmo-stp_10.42.42.5(pid=7392) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7392)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:35:10.217625 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:35:10.245296 run osmo-hlr_10.42.42.2(pid=7389): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7389)] 01:35:10.293092 run osmo-hlr_10.42.42.2(pid=7389): stdout: | (launched: 2022-12-09_01:35:07.411683) 01:35:10.342519 run osmo-hlr_10.42.42.2(pid=7389): stderr: | 20221209013507589 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013507589 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013507589 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013507589 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013507589 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013507589 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013507601 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013507609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013507609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013507609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:10.412052 run osmo-msc_10.42.42.6(pid=7395): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7395)] 01:35:10.459588 run osmo-msc_10.42.42.6(pid=7395): stdout: | (launched: 2022-12-09_01:35:09.329052) 01:35:10.509105 run osmo-msc_10.42.42.6(pid=7395): stderr: | 20221209013509598 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013509598 DLGLOBAL DEBUG validating counter group 0x7fc4a3bbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013509598 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013509598 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013509599 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013509599 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013509600 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013509601 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013509601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013509601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:10.558520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7388): Terminating (SIGTERM) 01:35:10.598074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7391): Terminating (SIGTERM) 01:35:10.637935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7394): Terminating (SIGTERM) 01:35:10.677896 --- ParallelTerminationStrategy: PID 7388 died... 01:35:10.696844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7388): Terminated: ok {rc=0} 01:35:10.741434 --- ParallelTerminationStrategy: PID 7391 died... 01:35:10.760212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7391): Terminated: ok {rc=0} 01:35:10.804721 --- ParallelTerminationStrategy: PID 7394 died... 01:35:10.823268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7394): Terminated: ok {rc=0} 01:35:10.908472 bus /sierra_3: Setting Powered False 01:35:12.007167 bus /sierra_3: Setting Powered False 01:35:13.122525 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:35:14.268274 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:14.280170 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:35:14.346115 tst mo_mt_call_osmux.py: using LAC 18155 01:35:14.468760 tst mo_mt_call_osmux.py: using RAC 50 01:35:14.588474 tst mo_mt_call_osmux.py: using CellId 18155 01:35:14.710894 tst mo_mt_call_osmux.py: using BVCI 18156 01:35:14.823771 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:14.835040 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:14.846115 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:14.857380 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:14.868753 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:35:14.880073 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:35:14.994969 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:35:15.113841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:15.619529 run create_hlr_db(pid=7397): Launched 01:35:15.752120 bus /sierra_2: Setting Powered False 01:35:16.818287 run create_hlr_db(pid=7397): Terminated: ok {rc=0} 01:35:17.286916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7399): Launched 01:35:17.603702 run osmo-hlr_10.42.42.2(pid=7400): Launched 01:35:17.719859 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:18.259533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7402): Launched 01:35:18.563903 run osmo-stp_10.42.42.5(pid=7403): Launched 01:35:18.679244 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:19.226155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7405): Launched 01:35:19.530528 run osmo-msc_10.42.42.6(pid=7406): Launched 01:35:19.700554 run osmo-stp_10.42.42.5(pid=7403): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7403)] 01:35:19.829218 run osmo-stp_10.42.42.5(pid=7403): stdout: | (launched: 2022-12-09_01:35:18.507837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:19.957484 run osmo-stp_10.42.42.5(pid=7403): stderr: | 20221209013518677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013518677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013518678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013518678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013518679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013518679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013518679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:20.083570 run osmo-stp_10.42.42.5(pid=7403): stdout: | (launched: 2022-12-09_01:35:18.507837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:20.203914 run osmo-stp_10.42.42.5(pid=7403): stderr: | 20221209013518677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013518677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013518678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013518678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013518679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013518679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013518679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:20.348718 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7403): Process ended prematurely: osmo-stp_10.42.42.5(pid=7403) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7403)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:35:20.357526 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:35:20.385179 run osmo-hlr_10.42.42.2(pid=7400): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7400)] 01:35:20.433426 run osmo-hlr_10.42.42.2(pid=7400): stdout: | (launched: 2022-12-09_01:35:17.547692) 01:35:20.483564 run osmo-hlr_10.42.42.2(pid=7400): stderr: | 20221209013517724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013517724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013517724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013517724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013517725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013517725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013517744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013517754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013517754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013517754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:20.553271 run osmo-msc_10.42.42.6(pid=7406): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7406)] 01:35:20.601331 run osmo-msc_10.42.42.6(pid=7406): stdout: | (launched: 2022-12-09_01:35:19.474426) 01:35:20.651056 run osmo-msc_10.42.42.6(pid=7406): stderr: | 20221209013519746 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013519746 DLGLOBAL DEBUG validating counter group 0x7f5484b72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013519746 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013519747 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013519747 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013519747 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013519749 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013519749 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013519749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013519749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:20.701315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7399): Terminating (SIGTERM) 01:35:20.741147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7402): Terminating (SIGTERM) 01:35:20.780656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7405): Terminating (SIGTERM) 01:35:20.820937 --- ParallelTerminationStrategy: PID 7399 died... 01:35:20.840230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7399): Terminated: ok {rc=0} 01:35:20.884714 --- ParallelTerminationStrategy: PID 7402 died... 01:35:20.903476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7402): Terminated: ok {rc=0} 01:35:20.947839 --- ParallelTerminationStrategy: PID 7405 died... 01:35:20.966664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7405): Terminated: ok {rc=0} 01:35:21.052671 bus /sierra_3: Setting Powered False 01:35:22.152665 bus /sierra_3: Setting Powered False 01:35:23.268919 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:35:24.512430 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:35:24.518953 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:35:24.548227 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:35:24.574422 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:35:24.626703 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:35:24.655796 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:35:24.682183 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:35:25.240672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:35:25.290031 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:25.301129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:35:25.363897 tst mo_mt_call.py: using LAC 18156 01:35:25.481696 tst mo_mt_call.py: using RAC 51 01:35:25.600685 tst mo_mt_call.py: using CellId 18156 01:35:25.718235 tst mo_mt_call.py: using BVCI 18157 01:35:25.830943 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:25.842129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:25.853091 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:25.864203 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:25.875599 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:25.886841 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:35:26.005383 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:35:26.121479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:26.593793 run create_hlr_db(pid=7411): Launched 01:35:26.710700 bus /sierra_2: Setting Powered False 01:35:27.771540 run create_hlr_db(pid=7411): Terminated: ok {rc=0} 01:35:28.218152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7413): Launched 01:35:28.545407 run osmo-hlr_10.42.42.2(pid=7414): Launched 01:35:28.671543 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:29.235004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7416): Launched 01:35:29.560684 run osmo-stp_10.42.42.5(pid=7417): Launched 01:35:29.685820 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:30.275733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7419): Launched 01:35:30.602812 run osmo-msc_10.42.42.6(pid=7420): Launched 01:35:30.785540 run osmo-stp_10.42.42.5(pid=7417): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7417)] 01:35:30.983742 run osmo-stp_10.42.42.5(pid=7417): stdout: | (launched: 2022-12-09_01:35:29.501237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:31.188330 run osmo-stp_10.42.42.5(pid=7417): stderr: | 20221209013529693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013529693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013529693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013529694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013529694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013529694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013529694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:31.321244 run osmo-stp_10.42.42.5(pid=7417): stdout: | (launched: 2022-12-09_01:35:29.501237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:31.447059 run osmo-stp_10.42.42.5(pid=7417): stderr: | 20221209013529693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013529693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013529693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013529694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013529694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013529694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013529694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:31.598640 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7417): Process ended prematurely: osmo-stp_10.42.42.5(pid=7417) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7417)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:35:31.609054 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:35:31.639515 run osmo-hlr_10.42.42.2(pid=7414): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7414)] 01:35:31.692118 run osmo-hlr_10.42.42.2(pid=7414): stdout: | (launched: 2022-12-09_01:35:28.485699) 01:35:31.744402 run osmo-hlr_10.42.42.2(pid=7414): stderr: | 20221209013528684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013528684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013528684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013528684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013528684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013528684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013528698 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013528708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013528708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013528708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:31.816457 run osmo-msc_10.42.42.6(pid=7420): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7420)] 01:35:31.867408 run osmo-msc_10.42.42.6(pid=7420): stdout: | (launched: 2022-12-09_01:35:30.543162) 01:35:31.920375 run osmo-msc_10.42.42.6(pid=7420): stderr: | 20221209013530864 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013530864 DLGLOBAL DEBUG validating counter group 0x7f8238bccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013530864 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013530864 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013530864 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013530864 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013530866 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013530867 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013530867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013530867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:31.973094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7413): Terminating (SIGTERM) 01:35:32.016096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7416): Terminating (SIGTERM) 01:35:32.060729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7419): Terminating (SIGTERM) 01:35:32.106855 --- ParallelTerminationStrategy: PID 7413 died... 01:35:32.127382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7413): Terminated: ok {rc=0} 01:35:32.177887 --- ParallelTerminationStrategy: PID 7416 died... 01:35:32.197443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7416): Terminated: ok {rc=0} 01:35:32.245127 --- ParallelTerminationStrategy: PID 7419 died... 01:35:32.266364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7419): Terminated: ok {rc=0} 01:35:32.352464 bus /sierra_3: Setting Powered False 01:35:33.450808 bus /sierra_3: Setting Powered False 01:35:34.566675 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:35:35.717870 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:35.730317 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:35:35.798847 tst mo_mt_call_osmux.py: using LAC 18157 01:35:35.926741 tst mo_mt_call_osmux.py: using RAC 52 01:35:36.046159 tst mo_mt_call_osmux.py: using CellId 18157 01:35:36.166316 tst mo_mt_call_osmux.py: using BVCI 18158 01:35:36.277220 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:36.288405 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:36.299572 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:36.311271 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:36.323021 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:36.334759 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:35:36.453140 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:35:36.569445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:37.041672 run create_hlr_db(pid=7422): Launched 01:35:37.158101 bus /sierra_2: Setting Powered False 01:35:38.218988 run create_hlr_db(pid=7422): Terminated: ok {rc=0} 01:35:38.641988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7424): Launched 01:35:38.947235 run osmo-hlr_10.42.42.2(pid=7425): Launched 01:35:39.069537 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:39.608585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7427): Launched 01:35:39.912597 run osmo-stp_10.42.42.5(pid=7428): Launched 01:35:40.030119 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:40.579348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7430): Launched 01:35:40.884727 run osmo-msc_10.42.42.6(pid=7431): Launched 01:35:41.055332 run osmo-stp_10.42.42.5(pid=7428): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7428)] 01:35:41.184235 run osmo-stp_10.42.42.5(pid=7428): stdout: | (launched: 2022-12-09_01:35:39.856805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:41.312559 run osmo-stp_10.42.42.5(pid=7428): stderr: | 20221209013540027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013540027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013540027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013540028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013540028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013540028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013540028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:41.439283 run osmo-stp_10.42.42.5(pid=7428): stdout: | (launched: 2022-12-09_01:35:39.856805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:41.559662 run osmo-stp_10.42.42.5(pid=7428): stderr: | 20221209013540027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013540027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013540027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013540028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013540028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013540028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013540028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:41.703979 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7428): Process ended prematurely: osmo-stp_10.42.42.5(pid=7428) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7428)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:35:41.712822 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 01:35:41.739989 run osmo-hlr_10.42.42.2(pid=7425): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7425)] 01:35:41.787829 run osmo-hlr_10.42.42.2(pid=7425): stdout: | (launched: 2022-12-09_01:35:38.890711) 01:35:41.837405 run osmo-hlr_10.42.42.2(pid=7425): stderr: | 20221209013539067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013539067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013539067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013539067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013539067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013539067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013539079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013539088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013539088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013539088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:41.906728 run osmo-msc_10.42.42.6(pid=7431): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7431)] 01:35:41.954545 run osmo-msc_10.42.42.6(pid=7431): stdout: | (launched: 2022-12-09_01:35:40.827977) 01:35:42.003855 run osmo-msc_10.42.42.6(pid=7431): stderr: | 20221209013541100 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013541100 DLGLOBAL DEBUG validating counter group 0x7f0af4786c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013541100 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013541100 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013541100 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013541101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013541102 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013541103 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013541103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013541103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:42.053611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7424): Terminating (SIGTERM) 01:35:42.093359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7427): Terminating (SIGTERM) 01:35:42.133200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7430): Terminating (SIGTERM) 01:35:42.173415 --- ParallelTerminationStrategy: PID 7424 died... 01:35:42.192481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7424): Terminated: ok {rc=0} 01:35:42.236573 --- ParallelTerminationStrategy: PID 7427 died... 01:35:42.255638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7427): Terminated: ok {rc=0} 01:35:42.300305 --- ParallelTerminationStrategy: PID 7430 died... 01:35:42.318929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7430): Terminated: ok {rc=0} 01:35:42.403903 bus /sierra_3: Setting Powered False 01:35:43.502731 bus /sierra_3: Setting Powered False 01:35:44.615460 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:35:45.866761 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:35:45.876046 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:35:45.916910 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:35:45.945078 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:35:46.001968 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:35:46.040842 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:35:46.068938 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:35:46.609136 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:35:46.673039 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:46.685707 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:35:46.755311 tst mo_mt_call.py: using LAC 18158 01:35:46.885452 tst mo_mt_call.py: using RAC 53 01:35:47.043046 tst mo_mt_call.py: using CellId 18158 01:35:47.177341 tst mo_mt_call.py: using BVCI 18159 01:35:47.299556 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:47.312215 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:47.326334 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:47.338333 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:47.349720 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:47.361747 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:47.482563 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:47.600542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:48.074087 run create_hlr_db(pid=7436): Launched 01:35:48.191713 bus /sierra_2: Setting Powered False 01:35:49.253594 run create_hlr_db(pid=7436): Terminated: ok {rc=0} 01:35:49.679059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7438): Launched 01:35:49.983716 run osmo-hlr_10.42.42.2(pid=7439): Launched 01:35:50.100768 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:50.635236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7441): Launched 01:35:50.940064 run osmo-stp_10.42.42.5(pid=7442): Launched 01:35:51.056627 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:51.606741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7444): Launched 01:35:51.911403 run osmo-msc_10.42.42.6(pid=7445): Launched 01:35:52.082499 run osmo-stp_10.42.42.5(pid=7442): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7442)] 01:35:52.211645 run osmo-stp_10.42.42.5(pid=7442): stdout: | (launched: 2022-12-09_01:35:50.883919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:52.340639 run osmo-stp_10.42.42.5(pid=7442): stderr: | 20221209013551051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013551051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013551051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013551052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013551052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013551052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013551052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:52.467557 run osmo-stp_10.42.42.5(pid=7442): stdout: | (launched: 2022-12-09_01:35:50.883919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:52.588194 run osmo-stp_10.42.42.5(pid=7442): stderr: | 20221209013551051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013551051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013551051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013551052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013551052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013551052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013551052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:52.733851 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7442): Process ended prematurely: osmo-stp_10.42.42.5(pid=7442) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7442)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:35:52.742785 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:35:52.769669 run osmo-hlr_10.42.42.2(pid=7439): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7439)] 01:35:52.817830 run osmo-hlr_10.42.42.2(pid=7439): stdout: | (launched: 2022-12-09_01:35:49.927905) 01:35:52.867456 run osmo-hlr_10.42.42.2(pid=7439): stderr: | 20221209013550102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013550102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013550102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013550102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013550102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013550102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013550114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013550125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013550125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013550125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:52.936606 run osmo-msc_10.42.42.6(pid=7445): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7445)] 01:35:52.984698 run osmo-msc_10.42.42.6(pid=7445): stdout: | (launched: 2022-12-09_01:35:51.855012) 01:35:53.034101 run osmo-msc_10.42.42.6(pid=7445): stderr: | 20221209013552125 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013552125 DLGLOBAL DEBUG validating counter group 0x7f1ffb479c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013552125 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013552125 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013552125 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013552125 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013552127 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013552127 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013552128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013552128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:53.084047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7438): Terminating (SIGTERM) 01:35:53.123978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7441): Terminating (SIGTERM) 01:35:53.164103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7444): Terminating (SIGTERM) 01:35:53.204226 --- ParallelTerminationStrategy: PID 7438 died... 01:35:53.223320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7438): Terminated: ok {rc=0} 01:35:53.267917 --- ParallelTerminationStrategy: PID 7441 died... 01:35:53.286639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7441): Terminated: ok {rc=0} 01:35:53.330976 --- ParallelTerminationStrategy: PID 7444 died... 01:35:53.349728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7444): Terminated: ok {rc=0} 01:35:53.435765 bus /sierra_3: Setting Powered False 01:35:54.536031 bus /sierra_3: Setting Powered False 01:35:55.648883 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:35:56.799538 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:56.812141 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:35:56.880246 tst mo_mt_call_osmux.py: using LAC 18159 01:35:57.013755 tst mo_mt_call_osmux.py: using RAC 54 01:35:57.141613 tst mo_mt_call_osmux.py: using CellId 18159 01:35:57.268536 tst mo_mt_call_osmux.py: using BVCI 18160 01:35:57.387504 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:57.399286 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:57.410978 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:57.422831 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:57.434914 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:57.446800 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:57.567636 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:57.685363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:58.158667 run create_hlr_db(pid=7447): Launched 01:35:58.275380 bus /sierra_2: Setting Powered False 01:35:59.335724 run create_hlr_db(pid=7447): Terminated: ok {rc=0} 01:35:59.781269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7449): Launched 01:36:00.108640 run osmo-hlr_10.42.42.2(pid=7450): Launched 01:36:00.233250 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:00.798840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7452): Launched 01:36:01.157703 run osmo-stp_10.42.42.5(pid=7453): Launched 01:36:01.400725 run osmo-msc_10.42.42.6: Starting osmo-msc 01:36:02.107688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7455): Launched 01:36:02.429299 run osmo-msc_10.42.42.6(pid=7456): Launched 01:36:02.601923 run osmo-stp_10.42.42.5(pid=7453): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7453)] 01:36:02.731097 run osmo-stp_10.42.42.5(pid=7453): stdout: | (launched: 2022-12-09_01:36:01.090418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:02.861316 run osmo-stp_10.42.42.5(pid=7453): stderr: | 20221209013601376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013601376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013601376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013601377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013601377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013601377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013601377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:02.987764 run osmo-stp_10.42.42.5(pid=7453): stdout: | (launched: 2022-12-09_01:36:01.090418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:03.108357 run osmo-stp_10.42.42.5(pid=7453): stderr: | 20221209013601376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013601376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013601376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013601377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013601377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013601377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013601377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:03.252770 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7453): Process ended prematurely: osmo-stp_10.42.42.5(pid=7453) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7453)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:36:03.261653 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:36:03.288721 run osmo-hlr_10.42.42.2(pid=7450): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7450)] 01:36:03.336415 run osmo-hlr_10.42.42.2(pid=7450): stdout: | (launched: 2022-12-09_01:36:00.049054) 01:36:03.385910 run osmo-hlr_10.42.42.2(pid=7450): stderr: | 20221209013600246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013600246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013600246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013600246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013600246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013600246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013600259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013600269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013600269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013600269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:03.455136 run osmo-msc_10.42.42.6(pid=7456): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7456)] 01:36:03.503282 run osmo-msc_10.42.42.6(pid=7456): stdout: | (launched: 2022-12-09_01:36:02.372821) 01:36:03.552816 run osmo-msc_10.42.42.6(pid=7456): stderr: | 20221209013602643 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013602643 DLGLOBAL DEBUG validating counter group 0x7f9ee7493c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013602643 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013602644 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013602644 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013602644 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013602646 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013602646 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013602646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013602646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:36:03.602961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7449): Terminating (SIGTERM) 01:36:03.642709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7452): Terminating (SIGTERM) 01:36:03.682344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7455): Terminating (SIGTERM) 01:36:03.722425 --- ParallelTerminationStrategy: PID 7449 died... 01:36:03.740928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7449): Terminated: ok {rc=0} 01:36:03.785348 --- ParallelTerminationStrategy: PID 7452 died... 01:36:03.803923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7452): Terminated: ok {rc=0} 01:36:03.848048 --- ParallelTerminationStrategy: PID 7455 died... 01:36:03.866672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7455): Terminated: ok {rc=0} 01:36:03.952084 bus /sierra_3: Setting Powered False 01:36:05.051138 bus /sierra_3: Setting Powered False 01:36:06.166637 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:36:07.414384 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:36:07.419830 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:36:07.449460 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:36:07.475367 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:36:07.527535 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:36:07.556585 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:36:07.582522 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:36:08.132111 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:36:08.181218 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:08.192176 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:36:08.257627 tst mo_mt_call.py: using LAC 18160 01:36:08.385960 tst mo_mt_call.py: using RAC 55 01:36:08.512462 tst mo_mt_call.py: using CellId 18160 01:36:08.654349 tst mo_mt_call.py: using BVCI 18161 01:36:08.773685 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:08.785489 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:08.796787 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:08.808501 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:08.820007 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:08.831302 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:36:08.950920 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:36:09.065567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:09.538234 run create_hlr_db(pid=7462): Launched 01:36:09.656764 bus /sierra_2: Setting Powered False 01:36:10.718184 run create_hlr_db(pid=7462): Terminated: ok {rc=0} 01:36:11.163349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7464): Launched 01:36:11.490759 run osmo-hlr_10.42.42.2(pid=7465): Launched 01:36:11.616293 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:12.181704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7467): Launched 01:36:12.508939 run osmo-stp_10.42.42.5(pid=7468): Launched 01:36:12.633700 run osmo-msc_10.42.42.6: Starting osmo-msc 01:36:13.223832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7470): Launched 01:36:13.551241 run osmo-msc_10.42.42.6(pid=7471): Launched 01:36:13.734320 run osmo-stp_10.42.42.5(pid=7468): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7468)] 01:36:13.872199 run osmo-stp_10.42.42.5(pid=7468): stdout: | (launched: 2022-12-09_01:36:12.449348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:14.010221 run osmo-stp_10.42.42.5(pid=7468): stderr: | 20221209013612641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013612641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013612642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013612642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013612643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013612643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013612643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:14.146969 run osmo-stp_10.42.42.5(pid=7468): stdout: | (launched: 2022-12-09_01:36:12.449348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:14.276643 run osmo-stp_10.42.42.5(pid=7468): stderr: | 20221209013612641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013612641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013612642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013612642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013612643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013612643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013612643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:14.432609 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7468): Process ended prematurely: osmo-stp_10.42.42.5(pid=7468) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7468)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:36:14.442016 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:36:14.470096 run osmo-hlr_10.42.42.2(pid=7465): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7465)] 01:36:14.520298 run osmo-hlr_10.42.42.2(pid=7465): stdout: | (launched: 2022-12-09_01:36:11.431198) 01:36:14.572106 run osmo-hlr_10.42.42.2(pid=7465): stderr: | 20221209013611628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013611628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013611628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013611628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013611628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013611629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013611641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013611650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013611650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013611650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:14.645094 run osmo-msc_10.42.42.6(pid=7471): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7471)] 01:36:14.694877 run osmo-msc_10.42.42.6(pid=7471): stdout: | (launched: 2022-12-09_01:36:13.491481) 01:36:14.746807 run osmo-msc_10.42.42.6(pid=7471): stderr: | 20221209013613813 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013613813 DLGLOBAL DEBUG validating counter group 0x7fe3b7dd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013613813 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013613813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013613813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013613814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013613815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013613816 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013613816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013613816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:36:14.799306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7464): Terminating (SIGTERM) 01:36:14.841302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7467): Terminating (SIGTERM) 01:36:14.882874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7470): Terminating (SIGTERM) 01:36:14.925633 --- ParallelTerminationStrategy: PID 7464 died... 01:36:14.945730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7464): Terminated: ok {rc=0} 01:36:14.992548 --- ParallelTerminationStrategy: PID 7467 died... 01:36:15.012401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7467): Terminated: ok {rc=0} 01:36:15.059290 --- ParallelTerminationStrategy: PID 7470 died... 01:36:15.079293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7470): Terminated: ok {rc=0} 01:36:15.168064 bus /sierra_3: Setting Powered False 01:36:16.265082 bus /sierra_3: Setting Powered False 01:36:17.380200 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:36:18.530044 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:18.542304 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:36:18.613046 tst mo_mt_call_osmux.py: using LAC 18161 01:36:18.742293 tst mo_mt_call_osmux.py: using RAC 56 01:36:18.872144 tst mo_mt_call_osmux.py: using CellId 18161 01:36:18.993747 tst mo_mt_call_osmux.py: using BVCI 18162 01:36:19.104642 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:19.116098 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:19.127182 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:19.138462 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:19.149831 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:19.160811 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:36:19.279315 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:36:19.398976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:19.906150 run create_hlr_db(pid=7473): Launched 01:36:20.039025 bus /sierra_2: Setting Powered False 01:36:21.103789 run create_hlr_db(pid=7473): Terminated: ok {rc=0} 01:36:21.539697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7475): Launched 01:36:21.846234 run osmo-hlr_10.42.42.2(pid=7476): Launched 01:36:21.963502 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:22.501379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7478): Launched 01:36:22.806694 run osmo-stp_10.42.42.5(pid=7479): Launched 01:36:22.923264 run osmo-msc_10.42.42.6: Starting osmo-msc 01:36:23.472625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7481): Launched 01:36:23.778472 run osmo-msc_10.42.42.6(pid=7482): Launched 01:36:23.949488 run osmo-stp_10.42.42.5(pid=7479): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7479)] 01:36:24.078285 run osmo-stp_10.42.42.5(pid=7479): stdout: | (launched: 2022-12-09_01:36:22.750218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:24.207046 run osmo-stp_10.42.42.5(pid=7479): stderr: | 20221209013622920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013622920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013622920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013622921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013622921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013622921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013622921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:24.333686 run osmo-stp_10.42.42.5(pid=7479): stdout: | (launched: 2022-12-09_01:36:22.750218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:24.454647 run osmo-stp_10.42.42.5(pid=7479): stderr: | 20221209013622920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013622920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013622920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013622921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013622921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013622921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013622921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:24.599641 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7479): Process ended prematurely: osmo-stp_10.42.42.5(pid=7479) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7479)] [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:36:24.608518 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:36:24.635825 run osmo-hlr_10.42.42.2(pid=7476): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7476)] 01:36:24.683969 run osmo-hlr_10.42.42.2(pid=7476): stdout: | (launched: 2022-12-09_01:36:21.789926) 01:36:24.734094 run osmo-hlr_10.42.42.2(pid=7476): stderr: | 20221209013621965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013621965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013621965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013621965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013621965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013621966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013621978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013621989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013621989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013621989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:24.803500 run osmo-msc_10.42.42.6(pid=7482): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7482)] 01:36:24.851828 run osmo-msc_10.42.42.6(pid=7482): stdout: | (launched: 2022-12-09_01:36:23.722075) 01:36:24.901336 run osmo-msc_10.42.42.6(pid=7482): stderr: | 20221209013623992 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013623992 DLGLOBAL DEBUG validating counter group 0x7f2de601bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013623992 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013623992 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013623993 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013623993 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013623995 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013623995 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013623995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013623995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:36:24.951470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7475): Terminating (SIGTERM) 01:36:24.991408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7478): Terminating (SIGTERM) 01:36:25.031189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7481): Terminating (SIGTERM) 01:36:25.071252 --- ParallelTerminationStrategy: PID 7475 died... 01:36:25.090442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7475): Terminated: ok {rc=0} 01:36:25.134861 --- ParallelTerminationStrategy: PID 7478 died... 01:36:25.153486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7478): Terminated: ok {rc=0} 01:36:25.197906 --- ParallelTerminationStrategy: PID 7481 died... 01:36:25.216538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7481): Terminated: ok {rc=0} 01:36:25.300205 bus /sierra_3: Setting Powered False 01:36:26.398155 bus /sierra_3: Setting Powered False 01:36:27.513473 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 01:36:28.752051 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:36:28.756309 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:36:28.785304 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:36:28.811787 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 01:36:28.895437 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:36:28.924154 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:36:28.950250 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 01:36:29.535108 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2352 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 01:36:29.540065 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:29.550927 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:36:29.595951 tst emergency_mo_mt_call.py: using LAC 18162 01:36:29.713125 tst emergency_mo_mt_call.py: using RAC 57 01:36:29.832772 tst emergency_mo_mt_call.py: using CellId 18162 01:36:29.950546 tst emergency_mo_mt_call.py: using BVCI 18163 01:36:30.058708 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:30.069626 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:30.080216 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:30.091132 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:30.101963 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:30.112690 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:30.228530 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:30.348596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:30.847631 run create_hlr_db(pid=7488): Launched 01:36:31.014350 bus /sierra_2: Setting Powered False 01:36:32.088783 run create_hlr_db(pid=7488): Terminated: ok {rc=0} 01:36:32.547379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7490): Launched 01:36:32.848190 run osmo-hlr_10.42.42.2(pid=7491): Launched 01:36:32.962177 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:33.478245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7493): Launched 01:36:33.777653 run osmo-stp_10.42.42.5(pid=7494): Launched 01:36:33.901256 tst emergency_mo_mt_call.py: using MSISDN 6954 01:36:34.053317 run osmo-msc_10.42.42.6: Starting osmo-msc 01:36:34.594079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7496): Launched 01:36:34.894231 run osmo-msc_10.42.42.6(pid=7497): Launched 01:36:35.062802 run osmo-stp_10.42.42.5(pid=7494): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7494)] 01:36:35.190607 run osmo-stp_10.42.42.5(pid=7494): stdout: | (launched: 2022-12-09_01:36:33.721842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:35.317616 run osmo-stp_10.42.42.5(pid=7494): stderr: | 20221209013633889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013633890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013633890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013633890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013633892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013633892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013633892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:35.442331 run osmo-stp_10.42.42.5(pid=7494): stdout: | (launched: 2022-12-09_01:36:33.721842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:35.560891 run osmo-stp_10.42.42.5(pid=7494): stderr: | 20221209013633889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013633890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013633890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013633890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013633892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013633892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013633892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:35.703360 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7494): Process ended prematurely: osmo-stp_10.42.42.5(pid=7494) [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7494)] [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 01:36:35.711528 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 01:36:35.738317 run osmo-hlr_10.42.42.2(pid=7491): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7491)] 01:36:35.786558 run osmo-hlr_10.42.42.2(pid=7491): stdout: | (launched: 2022-12-09_01:36:32.792862) 01:36:35.836576 run osmo-hlr_10.42.42.2(pid=7491): stderr: | 20221209013632968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013632968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013632968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013632968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013632968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013632968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013632980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013632990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013632990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013632990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:35.906004 run osmo-msc_10.42.42.6(pid=7497): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7497)] 01:36:35.953995 run osmo-msc_10.42.42.6(pid=7497): stdout: | (launched: 2022-12-09_01:36:34.838811) 01:36:36.003542 run osmo-msc_10.42.42.6(pid=7497): stderr: | 20221209013635109 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013635109 DLGLOBAL DEBUG validating counter group 0x7ff090e3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013635109 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013635109 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013635109 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013635110 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013635111 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013635112 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013635112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013635112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:36:36.053595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7490): Terminating (SIGTERM) 01:36:36.093311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7493): Terminating (SIGTERM) 01:36:36.133199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7496): Terminating (SIGTERM) 01:36:36.173945 --- ParallelTerminationStrategy: PID 7490 died... 01:36:36.193063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7490): Terminated: ok {rc=0} 01:36:36.237495 --- ParallelTerminationStrategy: PID 7493 died... 01:36:36.255869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7493): Terminated: ok {rc=0} 01:36:36.300364 --- ParallelTerminationStrategy: PID 7496 died... 01:36:36.318914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7496): Terminated: ok {rc=0} 01:36:36.403023 bus /sierra_3: Setting Powered False 01:36:37.498833 bus /sierra_3: Setting Powered False 01:36:38.613691 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 01:36:39.700134 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:39.711639 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:36:39.758896 tst emergency_preemptive_call.py: using LAC 18163 01:36:39.880228 tst emergency_preemptive_call.py: using RAC 58 01:36:40.005762 tst emergency_preemptive_call.py: using CellId 18163 01:36:40.129469 tst emergency_preemptive_call.py: using BVCI 18164 01:36:40.239604 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:40.250772 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:40.261673 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:40.272774 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:40.283975 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:40.295165 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:40.408565 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:40.527364 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:40.642610 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:40.757447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:41.223187 run create_hlr_db(pid=7499): Launched 01:36:41.338885 bus /sierra_2: Setting Powered False 01:36:42.399124 run create_hlr_db(pid=7499): Terminated: ok {rc=0} 01:36:42.839625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7501): Launched 01:36:43.161729 run osmo-hlr_10.42.42.2(pid=7502): Launched 01:36:43.284691 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:43.803664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7504): Launched 01:36:44.104358 run osmo-stp_10.42.42.5(pid=7505): Launched 01:36:44.228499 tst emergency_preemptive_call.py: using MSISDN 6955 01:36:44.381602 run osmo-msc_10.42.42.6: Starting osmo-msc 01:36:44.918516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7507): Launched 01:36:45.218021 run osmo-msc_10.42.42.6(pid=7508): Launched 01:36:45.386682 run osmo-stp_10.42.42.5(pid=7505): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7505)] 01:36:45.513530 run osmo-stp_10.42.42.5(pid=7505): stdout: | (launched: 2022-12-09_01:36:44.048828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:45.640376 run osmo-stp_10.42.42.5(pid=7505): stderr: | 20221209013644218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013644218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013644218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013644219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013644219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013644219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013644219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:45.765501 run osmo-stp_10.42.42.5(pid=7505): stdout: | (launched: 2022-12-09_01:36:44.048828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:45.890407 run osmo-stp_10.42.42.5(pid=7505): stderr: | 20221209013644218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013644218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013644218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013644219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013644219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013644219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013644219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:46.035559 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7505): Process ended prematurely: osmo-stp_10.42.42.5(pid=7505) [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7505)] [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 01:36:46.045131 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 01:36:46.075002 run osmo-hlr_10.42.42.2(pid=7502): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7502)] 01:36:46.125413 run osmo-hlr_10.42.42.2(pid=7502): stdout: | (launched: 2022-12-09_01:36:43.102424) 01:36:46.177504 run osmo-hlr_10.42.42.2(pid=7502): stderr: | 20221209013643299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013643299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013643299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013643299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013643300 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013643300 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013643311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013643320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013643320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013643320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:46.249429 run osmo-msc_10.42.42.6(pid=7508): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7508)] 01:36:46.300042 run osmo-msc_10.42.42.6(pid=7508): stdout: | (launched: 2022-12-09_01:36:45.162378) 01:36:46.351787 run osmo-msc_10.42.42.6(pid=7508): stderr: | 20221209013645433 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209013645433 DLGLOBAL DEBUG validating counter group 0x7fa80e316c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209013645433 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209013645433 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209013645433 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209013645434 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209013645435 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209013645436 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209013645436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209013645436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:36:46.404236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7501): Terminating (SIGTERM) 01:36:46.447038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7504): Terminating (SIGTERM) 01:36:46.491253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7507): Terminating (SIGTERM) 01:36:46.535152 --- ParallelTerminationStrategy: PID 7501 died... 01:36:46.555080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7501): Terminated: ok {rc=0} 01:36:46.602586 --- ParallelTerminationStrategy: PID 7504 died... 01:36:46.622352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7504): Terminated: ok {rc=0} 01:36:46.669744 --- ParallelTerminationStrategy: PID 7507 died... 01:36:46.689489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7507): Terminated: ok {rc=0} 01:36:46.780640 bus /sierra_9: Setting Powered False 01:36:47.877233 bus /sierra_9: Setting Powered False 01:36:48.991708 bus /sierra_8: Setting Powered False 01:36:50.089833 bus /sierra_8: Setting Powered False 01:36:51.205555 bus /sierra_3: Setting Powered False 01:36:52.303791 bus /sierra_3: Setting Powered False 01:36:53.420156 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 01:36:54.691606 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:36:54.696189 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:36:54.726992 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 01:36:54.765768 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 01:36:54.852536 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:36:54.881932 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 01:36:54.920747 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 01:36:55.510441 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 01:36:55.561876 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:55.572681 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:36:55.619540 tst cs_paging_gprs_active.py: using LAC 18164 01:36:55.742057 tst cs_paging_gprs_active.py: using RAC 59 01:36:55.862041 tst cs_paging_gprs_active.py: using CellId 18164 01:36:55.982537 tst cs_paging_gprs_active.py: using BVCI 18165 01:36:56.095379 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:56.106259 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:56.116775 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:56.127591 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:56.138303 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:56.149237 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:56.160129 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:56.171219 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:56.182279 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:56.301299 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:56.419228 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:36:56.625734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:56.933530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7513): Launched 01:36:57.202033 run iperf3-srv_10.42.42.10(pid=7514): Launched 01:36:57.318302 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:36:57.523911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:57.832096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7515): Launched 01:36:58.099715 run iperf3-srv_10.42.42.10(pid=7516): Launched 01:36:58.214688 tst cs_paging_gprs_active.py:38: start network... 01:36:58.418609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:58.891246 run create_hlr_db(pid=7517): Launched 01:36:59.007738 bus /sierra_2: Setting Powered False 01:37:00.069576 run create_hlr_db(pid=7517): Terminated: ok {rc=0} 01:37:00.496429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7519): Launched 01:37:00.827389 run osmo-hlr_10.42.42.2(pid=7520): Launched 01:37:01.101526 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:01.738163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7522): Launched 01:37:02.084762 run osmo-stp_10.42.42.5(pid=7523): Launched 01:37:02.289280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:02.887249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7525): Launched 01:37:03.013419 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:03.291983 run patchelf(pid=7526): Launched 01:37:03.475422 run osmo-stp_10.42.42.5(pid=7523): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7523)] 01:37:03.614884 run osmo-stp_10.42.42.5(pid=7523): stdout: | (launched: 2022-12-09_01:37:02.022478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:03.756265 run osmo-stp_10.42.42.5(pid=7523): stderr: | 20221209013702274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013702275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013702275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013702275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013702276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013702276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013702276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:03.898476 run osmo-stp_10.42.42.5(pid=7523): stdout: | (launched: 2022-12-09_01:37:02.022478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:04.033128 run osmo-stp_10.42.42.5(pid=7523): stderr: | 20221209013702274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013702275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013702275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013702275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013702276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013702276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013702276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:04.192244 run patchelf(pid=7526): Terminating (SIGINT) 01:37:04.377347 run patchelf(pid=7526): Terminated: ok {rc=0} 01:37:04.510612 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7523): Process ended prematurely: osmo-stp_10.42.42.5(pid=7523) [trial-2352↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7523)] [trial-2352↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 01:37:04.520693 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 01:37:04.549525 run osmo-hlr_10.42.42.2(pid=7520): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7520)] 01:37:04.599544 run osmo-hlr_10.42.42.2(pid=7520): stdout: | (launched: 2022-12-09_01:37:00.767475) 01:37:04.651394 run osmo-hlr_10.42.42.2(pid=7520): stderr: | 20221209013701050 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013701050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013701050 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013701050 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013701050 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013701050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013701066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013701087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013701087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013701087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:04.703565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7513): Terminating (SIGTERM) 01:37:04.745564 run iperf3-srv_10.42.42.10(pid=7514): Terminating (SIGTERM) 01:37:04.787423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7515): Terminating (SIGTERM) 01:37:04.829834 run iperf3-srv_10.42.42.10(pid=7516): Terminating (SIGTERM) 01:37:04.871808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7519): Terminating (SIGTERM) 01:37:04.914037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7522): Terminating (SIGTERM) 01:37:04.955968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7525): Terminating (SIGTERM) 01:37:04.998345 --- ParallelTerminationStrategy: PID 7513 died... 01:37:05.018593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7513): Terminated: ok {rc=0} 01:37:05.065310 --- ParallelTerminationStrategy: PID 7514 died... 01:37:05.085023 run iperf3-srv_10.42.42.10(pid=7514): Terminated {rc=256} 01:37:05.131311 --- ParallelTerminationStrategy: PID 7515 died... 01:37:05.150972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7515): Terminated: ok {rc=0} 01:37:05.197144 --- ParallelTerminationStrategy: PID 7516 died... 01:37:05.216680 run iperf3-srv_10.42.42.10(pid=7516): Terminated {rc=256} 01:37:05.262608 --- ParallelTerminationStrategy: PID 7519 died... 01:37:05.282298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7519): Terminated: ok {rc=0} 01:37:05.328794 --- ParallelTerminationStrategy: PID 7522 died... 01:37:05.348505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7522): Terminated: ok {rc=0} 01:37:05.394622 --- ParallelTerminationStrategy: PID 7525 died... 01:37:05.414428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7525): Terminated: ok {rc=0} 01:37:05.502194 bus /gobi_0: Setting Powered False 01:37:06.600831 bus /gobi_0: Setting Powered False 01:37:07.716374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 01:37:08.862697 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:08.874220 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:37:08.921713 tst iperf3.py: using LAC 18165 01:37:09.052152 tst iperf3.py: using RAC 60 01:37:09.180707 tst iperf3.py: using CellId 18165 01:37:09.310300 tst iperf3.py: using BVCI 18166 01:37:09.431183 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:09.442537 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:09.453547 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:09.464565 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:09.475516 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:09.486555 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:09.497764 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:09.508702 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:09.520033 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:09.636807 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:37:09.841590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:10.148320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7527): Launched 01:37:10.415237 run iperf3-srv_10.42.42.10(pid=7528): Launched 01:37:10.530127 tst iperf3.py:8: start network... 01:37:10.741617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:11.249297 run create_hlr_db(pid=7529): Launched 01:37:11.382961 bus /gobi_6: Setting Powered False 01:37:12.447391 run create_hlr_db(pid=7529): Terminated: ok {rc=0} 01:37:12.900785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7531): Launched 01:37:13.226847 run osmo-hlr_10.42.42.2(pid=7532): Launched 01:37:13.351333 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:13.918277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7534): Launched 01:37:14.245854 run osmo-stp_10.42.42.5(pid=7535): Launched 01:37:14.370783 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:14.934867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7537): Launched 01:37:15.060355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:15.337538 run patchelf(pid=7538): Launched 01:37:15.521107 run osmo-stp_10.42.42.5(pid=7535): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7535)] 01:37:15.660258 run osmo-stp_10.42.42.5(pid=7535): stdout: | (launched: 2022-12-09_01:37:14.185920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:15.800889 run osmo-stp_10.42.42.5(pid=7535): stderr: | 20221209013714379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013714379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013714379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013714379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013714380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013714380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013714380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:15.945076 run osmo-stp_10.42.42.5(pid=7535): stdout: | (launched: 2022-12-09_01:37:14.185920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:16.081740 run osmo-stp_10.42.42.5(pid=7535): stderr: | 20221209013714379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013714379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013714379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013714379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013714380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013714380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013714380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:16.244253 run patchelf(pid=7538): Terminating (SIGINT) 01:37:16.432631 run patchelf(pid=7538): Terminated: ok {rc=0} 01:37:16.568574 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7535): Process ended prematurely: osmo-stp_10.42.42.5(pid=7535) [trial-2352↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7535)] [trial-2352↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 01:37:16.579762 tst iperf3.py:8: Test FAILED (7.8 sec) 01:37:16.609788 run osmo-hlr_10.42.42.2(pid=7532): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7532)] 01:37:16.661206 run osmo-hlr_10.42.42.2(pid=7532): stdout: | (launched: 2022-12-09_01:37:13.167349) 01:37:16.713959 run osmo-hlr_10.42.42.2(pid=7532): stderr: | 20221209013713364 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013713364 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013713364 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013713364 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013713364 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013713365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013713377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013713386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013713386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013713386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:16.767020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7527): Terminating (SIGTERM) 01:37:16.810297 run iperf3-srv_10.42.42.10(pid=7528): Terminating (SIGTERM) 01:37:16.856125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7531): Terminating (SIGTERM) 01:37:16.899719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7534): Terminating (SIGTERM) 01:37:16.944403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7537): Terminating (SIGTERM) 01:37:16.988907 --- ParallelTerminationStrategy: PID 7527 died... 01:37:17.009384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7527): Terminated: ok {rc=0} 01:37:17.056649 --- ParallelTerminationStrategy: PID 7528 died... 01:37:17.076864 run iperf3-srv_10.42.42.10(pid=7528): Terminated {rc=256} 01:37:17.123872 --- ParallelTerminationStrategy: PID 7531 died... 01:37:17.143954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7531): Terminated: ok {rc=0} 01:37:17.190787 --- ParallelTerminationStrategy: PID 7534 died... 01:37:17.210912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7534): Terminated: ok {rc=0} 01:37:17.256911 --- ParallelTerminationStrategy: PID 7537 died... 01:37:17.276701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7537): Terminated: ok {rc=0} 01:37:17.363739 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 01:37:18.511549 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:18.523150 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:37:18.569917 tst iperf3m4.py: using LAC 18166 01:37:18.692900 tst iperf3m4.py: using RAC 61 01:37:18.818200 tst iperf3m4.py: using CellId 18166 01:37:18.938873 tst iperf3m4.py: using BVCI 18167 01:37:19.051855 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:19.062844 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:19.073749 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:19.085276 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:19.096680 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:19.108057 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:19.119616 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:19.130796 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:19.142470 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:19.262574 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:19.383378 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:19.503204 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:19.624200 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:37:19.830465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:20.137555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7539): Launched 01:37:20.405311 run iperf3-srv_10.42.42.10(pid=7540): Launched 01:37:20.520883 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:37:20.726839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:21.034671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7541): Launched 01:37:21.302010 run iperf3-srv_10.42.42.10(pid=7542): Launched 01:37:21.416890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:37:21.622698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:21.929573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7543): Launched 01:37:22.196907 run iperf3-srv_10.42.42.10(pid=7544): Launched 01:37:22.311559 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:37:22.516177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:22.823295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7545): Launched 01:37:23.090069 run iperf3-srv_10.42.42.10(pid=7546): Launched 01:37:23.204884 tst iperf3m4.py:8: start network... 01:37:23.409507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:23.881344 run create_hlr_db(pid=7547): Launched 01:37:23.998017 bus /gobi_6: Setting Powered False 01:37:25.059291 run create_hlr_db(pid=7547): Terminated: ok {rc=0} 01:37:25.484850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7549): Launched 01:37:25.792243 run osmo-hlr_10.42.42.2(pid=7550): Launched 01:37:25.909705 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:26.547398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7552): Launched 01:37:26.846023 run osmo-stp_10.42.42.5(pid=7553): Launched 01:37:26.959757 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:27.474795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7555): Launched 01:37:27.599093 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:27.870097 run patchelf(pid=7556): Launched 01:37:28.048073 run osmo-stp_10.42.42.5(pid=7553): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7553)] 01:37:28.183852 run osmo-stp_10.42.42.5(pid=7553): stdout: | (launched: 2022-12-09_01:37:26.791195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:28.321397 run osmo-stp_10.42.42.5(pid=7553): stderr: | 20221209013726957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013726957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013726957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013726958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013726958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013726958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013726959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:28.458956 run osmo-stp_10.42.42.5(pid=7553): stdout: | (launched: 2022-12-09_01:37:26.791195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:28.589772 run osmo-stp_10.42.42.5(pid=7553): stderr: | 20221209013726957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013726957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013726957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013726958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013726958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013726958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013726959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:28.744628 run patchelf(pid=7556): Terminating (SIGINT) 01:37:28.924798 run patchelf(pid=7556): Terminated: ok {rc=0} 01:37:29.054366 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7553): Process ended prematurely: osmo-stp_10.42.42.5(pid=7553) [trial-2352↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7553)] [trial-2352↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 01:37:29.064429 tst iperf3m4.py:8: Test FAILED (10.6 sec) 01:37:29.093470 run osmo-hlr_10.42.42.2(pid=7550): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7550)] 01:37:29.143661 run osmo-hlr_10.42.42.2(pid=7550): stdout: | (launched: 2022-12-09_01:37:25.735129) 01:37:29.195572 run osmo-hlr_10.42.42.2(pid=7550): stderr: | 20221209013725909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013725909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013725909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013725909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013725909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013725909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013725921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013725930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013725930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013725930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:29.247692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7539): Terminating (SIGTERM) 01:37:29.289576 run iperf3-srv_10.42.42.10(pid=7540): Terminating (SIGTERM) 01:37:29.331297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7541): Terminating (SIGTERM) 01:37:29.373479 run iperf3-srv_10.42.42.10(pid=7542): Terminating (SIGTERM) 01:37:29.415129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7543): Terminating (SIGTERM) 01:37:29.456772 run iperf3-srv_10.42.42.10(pid=7544): Terminating (SIGTERM) 01:37:29.498615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7545): Terminating (SIGTERM) 01:37:29.540531 run iperf3-srv_10.42.42.10(pid=7546): Terminating (SIGTERM) 01:37:29.582289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7549): Terminating (SIGTERM) 01:37:29.624720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7552): Terminating (SIGTERM) 01:37:29.666345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7555): Terminating (SIGTERM) 01:37:29.708530 --- ParallelTerminationStrategy: PID 7539 died... 01:37:29.728784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7539): Terminated: ok {rc=0} 01:37:29.775442 --- ParallelTerminationStrategy: PID 7540 died... 01:37:29.794948 run iperf3-srv_10.42.42.10(pid=7540): Terminated {rc=256} 01:37:29.841965 --- ParallelTerminationStrategy: PID 7541 died... 01:37:29.861864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7541): Terminated: ok {rc=0} 01:37:29.908650 --- ParallelTerminationStrategy: PID 7542 died... 01:37:29.928470 run iperf3-srv_10.42.42.10(pid=7542): Terminated {rc=256} 01:37:29.974754 --- ParallelTerminationStrategy: PID 7543 died... 01:37:29.994710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7543): Terminated: ok {rc=0} 01:37:30.041152 --- ParallelTerminationStrategy: PID 7544 died... 01:37:30.060826 run iperf3-srv_10.42.42.10(pid=7544): Terminated {rc=256} 01:37:30.107372 --- ParallelTerminationStrategy: PID 7545 died... 01:37:30.127159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7545): Terminated: ok {rc=0} 01:37:30.173406 --- ParallelTerminationStrategy: PID 7546 died... 01:37:30.192883 run iperf3-srv_10.42.42.10(pid=7546): Terminated {rc=256} 01:37:30.239582 --- ParallelTerminationStrategy: PID 7549 died... 01:37:30.259500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7549): Terminated: ok {rc=0} 01:37:30.305656 --- ParallelTerminationStrategy: PID 7552 died... 01:37:30.325410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7552): Terminated: ok {rc=0} 01:37:30.371805 --- ParallelTerminationStrategy: PID 7555 died... 01:37:30.391533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7555): Terminated: ok {rc=0} 01:37:30.479050 bus /gobi_4: Setting Powered False 01:37:31.574438 bus /gobi_4: Setting Powered False 01:37:32.686854 bus /gobi_1: Setting Powered False 01:37:33.783920 bus /gobi_1: Setting Powered False 01:37:34.899617 bus /gobi_0: Setting Powered False 01:37:35.998688 bus /gobi_0: Setting Powered False 01:37:37.114010 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 01:37:38.217796 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:38.229516 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:37:38.277670 tst ping.py: using LAC 18167 01:37:38.402368 tst ping.py: using RAC 62 01:37:38.526772 tst ping.py: using CellId 18167 01:37:38.650048 tst ping.py: using BVCI 18168 01:37:38.764099 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:38.775245 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:38.786403 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:38.797939 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:38.809461 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:38.820845 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:38.832458 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:38.843998 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:38.960082 tst ping.py:19: start network... 01:37:39.172253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:39.658902 run create_hlr_db(pid=7562): Launched 01:37:39.787759 bus /gobi_6: Setting Powered False 01:37:40.850193 run create_hlr_db(pid=7562): Terminated: ok {rc=0} 01:37:41.289703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7564): Launched 01:37:41.603542 run osmo-hlr_10.42.42.2(pid=7565): Launched 01:37:41.723676 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:42.267688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7567): Launched 01:37:42.583430 run osmo-stp_10.42.42.5(pid=7568): Launched 01:37:42.703685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:43.247437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7570): Launched 01:37:43.367552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:43.633407 run patchelf(pid=7571): Launched 01:37:43.809205 run osmo-stp_10.42.42.5(pid=7568): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7568)] 01:37:43.943444 run osmo-stp_10.42.42.5(pid=7568): stdout: | (launched: 2022-12-09_01:37:42.525595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:44.078836 run osmo-stp_10.42.42.5(pid=7568): stderr: | 20221209013742717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013742717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013742718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013742718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013742718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013742719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013742719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:44.214280 run osmo-stp_10.42.42.5(pid=7568): stdout: | (launched: 2022-12-09_01:37:42.525595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:44.343524 run osmo-stp_10.42.42.5(pid=7568): stderr: | 20221209013742717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013742717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013742718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013742718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013742718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013742719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013742719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:44.496498 run patchelf(pid=7571): Terminating (SIGINT) 01:37:44.673162 run patchelf(pid=7571): Terminated: ok {rc=0} 01:37:44.800924 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7568): Process ended prematurely: osmo-stp_10.42.42.5(pid=7568) [trial-2352↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7568)] [trial-2352↪gprs:trx-lms-limenet-micro↪ping.py:22] 01:37:44.810484 tst ping.py:22: Test FAILED (6.6 sec) 01:37:44.838463 run osmo-hlr_10.42.42.2(pid=7565): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7565)] 01:37:44.888818 run osmo-hlr_10.42.42.2(pid=7565): stdout: | (launched: 2022-12-09_01:37:41.546034) 01:37:44.941082 run osmo-hlr_10.42.42.2(pid=7565): stderr: | 20221209013741743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013741743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013741743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013741743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013741743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013741743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013741756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013741764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013741764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013741764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:44.993540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7564): Terminating (SIGTERM) 01:37:45.035240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7567): Terminating (SIGTERM) 01:37:45.077119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7570): Terminating (SIGTERM) 01:37:45.118952 --- ParallelTerminationStrategy: PID 7564 died... 01:37:45.138977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7564): Terminated: ok {rc=0} 01:37:45.185159 --- ParallelTerminationStrategy: PID 7567 died... 01:37:45.204621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7567): Terminated: ok {rc=0} 01:37:45.250653 --- ParallelTerminationStrategy: PID 7570 died... 01:37:45.271431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7570): Terminated: ok {rc=0} 01:37:45.358464 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 01:37:46.446823 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:46.464147 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:37:46.514416 tst ping_idle_ping.py: using LAC 18168 01:37:46.644461 tst ping_idle_ping.py: using RAC 63 01:37:46.772201 tst ping_idle_ping.py: using CellId 18168 01:37:46.938949 tst ping_idle_ping.py: using BVCI 18169 01:37:47.049605 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:47.061512 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:47.072734 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:47.084720 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:47.096741 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:47.110543 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:47.122086 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:47.134337 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:47.248502 tst ping_idle_ping.py:24: start network... 01:37:47.449228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:47.911904 run create_hlr_db(pid=7572): Launched 01:37:48.026438 bus /gobi_6: Setting Powered False 01:37:49.085830 run create_hlr_db(pid=7572): Terminated: ok {rc=0} 01:37:49.499712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7574): Launched 01:37:49.797569 run osmo-hlr_10.42.42.2(pid=7575): Launched 01:37:49.910775 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:50.432748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7577): Launched 01:37:50.730539 run osmo-stp_10.42.42.5(pid=7578): Launched 01:37:50.844492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:51.357902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7580): Launched 01:37:51.473809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:51.725690 run patchelf(pid=7581): Launched 01:37:51.891590 run osmo-stp_10.42.42.5(pid=7578): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7578)] 01:37:52.018366 run osmo-stp_10.42.42.5(pid=7578): stdout: | (launched: 2022-12-09_01:37:50.675344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:52.146733 run osmo-stp_10.42.42.5(pid=7578): stderr: | 20221209013750844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013750844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013750844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013750845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013750845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013750845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013750845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:52.275246 run osmo-stp_10.42.42.5(pid=7578): stdout: | (launched: 2022-12-09_01:37:50.675344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:52.396923 run osmo-stp_10.42.42.5(pid=7578): stderr: | 20221209013750844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013750844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013750844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013750845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013750845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013750845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013750845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:52.541625 run patchelf(pid=7581): Terminating (SIGINT) 01:37:52.708546 run patchelf(pid=7581): Terminated: ok {rc=0} 01:37:52.828838 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7578): Process ended prematurely: osmo-stp_10.42.42.5(pid=7578) [trial-2352↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7578)] [trial-2352↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 01:37:52.837902 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:37:52.864938 run osmo-hlr_10.42.42.2(pid=7575): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7575)] 01:37:52.913335 run osmo-hlr_10.42.42.2(pid=7575): stdout: | (launched: 2022-12-09_01:37:49.743227) 01:37:52.962974 run osmo-hlr_10.42.42.2(pid=7575): stderr: | 20221209013749921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013749921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013749921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013749921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013749921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013749921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013749933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013749941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013749941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013749942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:53.013535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7574): Terminating (SIGTERM) 01:37:53.053568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7577): Terminating (SIGTERM) 01:37:53.093417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7580): Terminating (SIGTERM) 01:37:53.133639 --- ParallelTerminationStrategy: PID 7574 died... 01:37:53.152743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7574): Terminated: ok {rc=0} 01:37:53.197121 --- ParallelTerminationStrategy: PID 7577 died... 01:37:53.215475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7577): Terminated: ok {rc=0} 01:37:53.259860 --- ParallelTerminationStrategy: PID 7580 died... 01:37:53.278358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7580): Terminated: ok {rc=0} 01:37:53.361372 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 01:37:54.660524 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:37:54.666955 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:37:54.697790 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:37:54.737612 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:37:54.825675 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:37:54.855662 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:37:54.895019 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:37:55.491057 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:37:55.543628 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:55.555264 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:37:55.603731 tst cs_paging_gprs_active.py: using LAC 18169 01:37:55.732576 tst cs_paging_gprs_active.py: using RAC 64 01:37:55.860869 tst cs_paging_gprs_active.py: using CellId 18169 01:37:55.990750 tst cs_paging_gprs_active.py: using BVCI 18170 01:37:56.108685 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:56.120307 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:56.131594 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:56.143065 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:56.154484 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:56.165939 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:56.177557 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:56.189140 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:56.200872 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:56.317400 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:56.436862 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:37:56.654237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:56.979078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7585): Launched 01:37:57.259646 run iperf3-srv_10.42.42.10(pid=7586): Launched 01:37:57.380557 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:37:57.597393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:57.921681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7587): Launched 01:37:58.202024 run iperf3-srv_10.42.42.10(pid=7588): Launched 01:37:58.324169 tst cs_paging_gprs_active.py:38: start network... 01:37:58.540823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:59.040366 run create_hlr_db(pid=7589): Launched 01:37:59.171284 bus /gobi_6: Setting Powered False 01:38:00.235073 run create_hlr_db(pid=7589): Terminated: ok {rc=0} 01:38:00.666466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7591): Launched 01:38:00.985716 run osmo-hlr_10.42.42.2(pid=7592): Launched 01:38:01.222942 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:01.969148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Launched 01:38:02.329722 run osmo-stp_10.42.42.5(pid=7644): Launched 01:38:02.584803 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:03.454549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7715): Launched 01:38:03.650367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:03.967571 run patchelf(pid=7765): Launched 01:38:04.190793 run osmo-stp_10.42.42.5(pid=7644): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7644)] 01:38:04.355855 run osmo-stp_10.42.42.5(pid=7644): stdout: | (launched: 2022-12-09_01:38:02.259330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:04.522341 run osmo-stp_10.42.42.5(pid=7644): stderr: | 20221209013802627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013802627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013802627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013802628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013802628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013802628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013802628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:04.684762 run osmo-stp_10.42.42.5(pid=7644): stdout: | (launched: 2022-12-09_01:38:02.259330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:04.842822 run osmo-stp_10.42.42.5(pid=7644): stderr: | 20221209013802627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013802627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013802627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013802628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013802628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013802628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013802628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:04.992038 run patchelf(pid=7765): Terminating (SIGINT) 01:38:05.174011 run patchelf(pid=7765): Terminated: ok {rc=0} 01:38:05.299190 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7644): Process ended prematurely: osmo-stp_10.42.42.5(pid=7644) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7644)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:38:05.309872 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 01:38:05.341131 run osmo-hlr_10.42.42.2(pid=7592): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7592)] 01:38:05.391687 run osmo-hlr_10.42.42.2(pid=7592): stdout: | (launched: 2022-12-09_01:38:00.921721) 01:38:05.444556 run osmo-hlr_10.42.42.2(pid=7592): stderr: | 20221209013801160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013801160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013801160 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013801160 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013801160 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013801160 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013801189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013801206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013801206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013801206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:05.497339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7585): Terminating (SIGTERM) 01:38:05.540082 run iperf3-srv_10.42.42.10(pid=7586): Terminating (SIGTERM) 01:38:05.585764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7587): Terminating (SIGTERM) 01:38:05.629232 run iperf3-srv_10.42.42.10(pid=7588): Terminating (SIGTERM) 01:38:05.675027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7591): Terminating (SIGTERM) 01:38:05.719150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Terminating (SIGTERM) 01:38:05.763574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7715): Terminating (SIGTERM) 01:38:05.808481 --- ParallelTerminationStrategy: PID 7585 died... 01:38:05.828412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7585): Terminated: ok {rc=0} 01:38:05.877486 --- ParallelTerminationStrategy: PID 7586 died... 01:38:05.897057 run iperf3-srv_10.42.42.10(pid=7586): Terminated {rc=256} 01:38:05.943955 --- ParallelTerminationStrategy: PID 7587 died... 01:38:05.963617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7587): Terminated: ok {rc=0} 01:38:06.011051 --- ParallelTerminationStrategy: PID 7588 died... 01:38:06.030616 run iperf3-srv_10.42.42.10(pid=7588): Terminated {rc=256} 01:38:06.077526 --- ParallelTerminationStrategy: PID 7591 died... 01:38:06.097262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7591): Terminated: ok {rc=0} 01:38:06.144621 --- ParallelTerminationStrategy: PID 7636 died... 01:38:06.164469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Terminated: ok {rc=0} 01:38:06.215177 --- ParallelTerminationStrategy: PID 7715 died... 01:38:06.234651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7715): Terminated: ok {rc=0} 01:38:06.321946 bus /gobi_0: Setting Powered False 01:38:07.421645 bus /gobi_0: Setting Powered False 01:38:08.541682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:38:09.698808 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:09.712806 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:38:09.762256 tst iperf3.py: using LAC 18170 01:38:09.893779 tst iperf3.py: using RAC 65 01:38:10.023393 tst iperf3.py: using CellId 18170 01:38:10.152321 tst iperf3.py: using BVCI 18171 01:38:10.272840 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:10.285883 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:10.298136 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:10.311582 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:10.324425 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:10.336801 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:10.350123 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:10.362858 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:10.375909 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:10.502450 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:38:10.728840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:11.061214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7871): Launched 01:38:11.361892 run iperf3-srv_10.42.42.10(pid=7872): Launched 01:38:11.500830 tst iperf3.py:8: start network... 01:38:11.727714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:12.239924 run create_hlr_db(pid=7873): Launched 01:38:12.408800 bus /gobi_6: Setting Powered False 01:38:13.474943 run create_hlr_db(pid=7873): Terminated: ok {rc=0} 01:38:13.938016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7875): Launched 01:38:14.283939 run osmo-hlr_10.42.42.2(pid=7876): Launched 01:38:14.536317 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:15.188732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7878): Launched 01:38:15.533501 run osmo-stp_10.42.42.5(pid=7879): Launched 01:38:15.781426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:16.546189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7881): Launched 01:38:16.680631 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:16.945637 run patchelf(pid=7882): Launched 01:38:17.131014 run osmo-stp_10.42.42.5(pid=7879): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7879)] 01:38:17.262494 run osmo-stp_10.42.42.5(pid=7879): stdout: | (launched: 2022-12-09_01:38:15.471535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:17.395546 run osmo-stp_10.42.42.5(pid=7879): stderr: | 20221209013815767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013815767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013815767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013815768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013815768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013815768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013815768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:17.529073 run osmo-stp_10.42.42.5(pid=7879): stdout: | (launched: 2022-12-09_01:38:15.471535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:17.656473 run osmo-stp_10.42.42.5(pid=7879): stderr: | 20221209013815767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013815767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013815767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013815768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013815768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013815768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013815768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:17.807516 run patchelf(pid=7882): Terminating (SIGINT) 01:38:17.981667 run patchelf(pid=7882): Terminated: ok {rc=0} 01:38:18.107948 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7879): Process ended prematurely: osmo-stp_10.42.42.5(pid=7879) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7879)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 01:38:18.118675 tst iperf3.py:8: Test FAILED (8.5 sec) 01:38:18.149556 run osmo-hlr_10.42.42.2(pid=7876): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7876)] 01:38:18.200090 run osmo-hlr_10.42.42.2(pid=7876): stdout: | (launched: 2022-12-09_01:38:14.219768) 01:38:18.252284 run osmo-hlr_10.42.42.2(pid=7876): stderr: | 20221209013814531 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013814531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013814531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013814531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013814531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013814531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013814552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013814564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013814564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013814564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:18.305759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7871): Terminating (SIGTERM) 01:38:18.348625 run iperf3-srv_10.42.42.10(pid=7872): Terminating (SIGTERM) 01:38:18.391203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7875): Terminating (SIGTERM) 01:38:18.434454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7878): Terminating (SIGTERM) 01:38:18.479093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7881): Terminating (SIGTERM) 01:38:18.524392 --- ParallelTerminationStrategy: PID 7871 died... 01:38:18.545091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7871): Terminated: ok {rc=0} 01:38:18.595014 --- ParallelTerminationStrategy: PID 7872 died... 01:38:18.614790 run iperf3-srv_10.42.42.10(pid=7872): Terminated {rc=256} 01:38:18.662704 --- ParallelTerminationStrategy: PID 7875 died... 01:38:18.682510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7875): Terminated: ok {rc=0} 01:38:18.730351 --- ParallelTerminationStrategy: PID 7878 died... 01:38:18.750214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7878): Terminated: ok {rc=0} 01:38:18.798314 --- ParallelTerminationStrategy: PID 7881 died... 01:38:18.818205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7881): Terminated: ok {rc=0} 01:38:18.907430 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:38:20.059545 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.072199 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:38:20.123106 tst iperf3m4.py: using LAC 18171 01:38:20.246420 tst iperf3m4.py: using RAC 66 01:38:20.371511 tst iperf3m4.py: using CellId 18171 01:38:20.496757 tst iperf3m4.py: using BVCI 18172 01:38:20.614832 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.627259 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.640442 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.652364 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.664686 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.676876 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.692091 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.705067 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.719252 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:20.847131 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:20.969048 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:21.088087 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:21.210053 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:38:21.420064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:21.739231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7883): Launched 01:38:22.023570 run iperf3-srv_10.42.42.10(pid=7884): Launched 01:38:22.156474 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:38:22.367260 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:22.685207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7885): Launched 01:38:22.973492 run iperf3-srv_10.42.42.10(pid=7886): Launched 01:38:23.104848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:38:23.315278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:23.633564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7887): Launched 01:38:23.919129 run iperf3-srv_10.42.42.10(pid=7888): Launched 01:38:24.050548 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:38:24.260838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:24.580590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7889): Launched 01:38:24.873735 run iperf3-srv_10.42.42.10(pid=7890): Launched 01:38:25.007701 tst iperf3m4.py:8: start network... 01:38:25.228691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:25.740763 run create_hlr_db(pid=7891): Launched 01:38:25.904936 bus /gobi_6: Setting Powered False 01:38:26.968802 run create_hlr_db(pid=7891): Terminated: ok {rc=0} 01:38:27.397677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7893): Launched 01:38:27.699531 run osmo-hlr_10.42.42.2(pid=7894): Launched 01:38:27.814680 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:28.336498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7896): Launched 01:38:28.640110 run osmo-stp_10.42.42.5(pid=7897): Launched 01:38:28.756274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:29.277605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7899): Launched 01:38:29.393746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:29.649644 run patchelf(pid=7900): Launched 01:38:29.819254 run osmo-stp_10.42.42.5(pid=7897): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7897)] 01:38:29.947807 run osmo-stp_10.42.42.5(pid=7897): stdout: | (launched: 2022-12-09_01:38:28.584165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:30.078271 run osmo-stp_10.42.42.5(pid=7897): stderr: | 20221209013828750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013828751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013828751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013828751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013828752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013828752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013828752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:30.208685 run osmo-stp_10.42.42.5(pid=7897): stdout: | (launched: 2022-12-09_01:38:28.584165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:30.332842 run osmo-stp_10.42.42.5(pid=7897): stderr: | 20221209013828750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013828751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013828751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013828751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013828752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013828752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013828752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:30.479913 run patchelf(pid=7900): Terminating (SIGINT) 01:38:30.650863 run patchelf(pid=7900): Terminated: ok {rc=0} 01:38:30.773973 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7897): Process ended prematurely: osmo-stp_10.42.42.5(pid=7897) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7897)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 01:38:30.783631 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:38:30.811605 run osmo-hlr_10.42.42.2(pid=7894): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7894)] 01:38:30.862684 run osmo-hlr_10.42.42.2(pid=7894): stdout: | (launched: 2022-12-09_01:38:27.643619) 01:38:30.920435 run osmo-hlr_10.42.42.2(pid=7894): stderr: | 20221209013827817 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013827817 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013827817 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013827818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013827818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013827818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013827831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013827841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013827841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013827842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:30.972547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7883): Terminating (SIGTERM) 01:38:31.014808 run iperf3-srv_10.42.42.10(pid=7884): Terminating (SIGTERM) 01:38:31.062082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7885): Terminating (SIGTERM) 01:38:31.114772 run iperf3-srv_10.42.42.10(pid=7886): Terminating (SIGTERM) 01:38:31.169198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7887): Terminating (SIGTERM) 01:38:31.226297 run iperf3-srv_10.42.42.10(pid=7888): Terminating (SIGTERM) 01:38:31.283643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7889): Terminating (SIGTERM) 01:38:31.336437 run iperf3-srv_10.42.42.10(pid=7890): Terminating (SIGTERM) 01:38:31.391589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7893): Terminating (SIGTERM) 01:38:31.444104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7896): Terminating (SIGTERM) 01:38:31.497990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7899): Terminating (SIGTERM) 01:38:31.547802 --- ParallelTerminationStrategy: PID 7883 died... 01:38:31.571765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7883): Terminated: ok {rc=0} 01:38:31.629851 --- ParallelTerminationStrategy: PID 7884 died... 01:38:31.655298 run iperf3-srv_10.42.42.10(pid=7884): Terminated {rc=256} 01:38:31.712312 --- ParallelTerminationStrategy: PID 7885 died... 01:38:31.734384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7885): Terminated: ok {rc=0} 01:38:31.793259 --- ParallelTerminationStrategy: PID 7886 died... 01:38:31.818648 run iperf3-srv_10.42.42.10(pid=7886): Terminated {rc=256} 01:38:31.876328 --- ParallelTerminationStrategy: PID 7887 died... 01:38:31.901405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7887): Terminated: ok {rc=0} 01:38:31.956820 --- ParallelTerminationStrategy: PID 7888 died... 01:38:31.981342 run iperf3-srv_10.42.42.10(pid=7888): Terminated {rc=256} 01:38:32.038236 --- ParallelTerminationStrategy: PID 7889 died... 01:38:32.062915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7889): Terminated: ok {rc=0} 01:38:32.117989 --- ParallelTerminationStrategy: PID 7890 died... 01:38:32.141991 run iperf3-srv_10.42.42.10(pid=7890): Terminated {rc=256} 01:38:32.199214 --- ParallelTerminationStrategy: PID 7893 died... 01:38:32.223797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7893): Terminated: ok {rc=0} 01:38:32.274401 --- ParallelTerminationStrategy: PID 7896 died... 01:38:32.293969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7896): Terminated: ok {rc=0} 01:38:32.341257 --- ParallelTerminationStrategy: PID 7899 died... 01:38:32.361251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7899): Terminated: ok {rc=0} 01:38:32.447697 bus /gobi_4: Setting Powered False 01:38:33.544756 bus /gobi_4: Setting Powered False 01:38:34.661310 bus /gobi_1: Setting Powered False 01:38:35.760166 bus /gobi_1: Setting Powered False 01:38:36.877899 bus /gobi_0: Setting Powered False 01:38:37.975322 bus /gobi_0: Setting Powered False 01:38:39.093856 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 01:38:40.196132 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:40.207871 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:38:40.255042 tst ping.py: using LAC 18172 01:38:40.371426 tst ping.py: using RAC 67 01:38:40.492639 tst ping.py: using CellId 18172 01:38:40.619178 tst ping.py: using BVCI 18173 01:38:40.733772 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:40.745542 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:40.757016 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:40.768677 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:40.780167 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:40.791588 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:40.803151 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:40.814436 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:40.933527 tst ping.py:19: start network... 01:38:41.146724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:41.635193 run create_hlr_db(pid=7901): Launched 01:38:41.763338 bus /gobi_6: Setting Powered False 01:38:42.826336 run create_hlr_db(pid=7901): Terminated: ok {rc=0} 01:38:43.250050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7903): Launched 01:38:43.545487 run osmo-hlr_10.42.42.2(pid=7904): Launched 01:38:43.659115 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:44.187827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7906): Launched 01:38:44.483174 run osmo-stp_10.42.42.5(pid=7907): Launched 01:38:44.596114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:45.110734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7909): Launched 01:38:45.225625 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:45.475221 run patchelf(pid=7910): Launched 01:38:45.640503 run osmo-stp_10.42.42.5(pid=7907): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7907)] 01:38:45.766325 run osmo-stp_10.42.42.5(pid=7907): stdout: | (launched: 2022-12-09_01:38:44.428358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:45.909792 run osmo-stp_10.42.42.5(pid=7907): stderr: | 20221209013844598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013844599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013844599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013844599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013844600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013844600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013844600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:46.041176 run osmo-stp_10.42.42.5(pid=7907): stdout: | (launched: 2022-12-09_01:38:44.428358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:46.165772 run osmo-stp_10.42.42.5(pid=7907): stderr: | 20221209013844598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013844599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013844599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013844599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013844600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013844600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013844600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:46.313819 run patchelf(pid=7910): Terminating (SIGINT) 01:38:46.484602 run patchelf(pid=7910): Terminated: ok {rc=0} 01:38:46.609471 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7907): Process ended prematurely: osmo-stp_10.42.42.5(pid=7907) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7907)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 01:38:46.619447 tst ping.py:22: Test FAILED (6.4 sec) 01:38:46.648831 run osmo-hlr_10.42.42.2(pid=7904): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7904)] 01:38:46.701850 run osmo-hlr_10.42.42.2(pid=7904): stdout: | (launched: 2022-12-09_01:38:43.491449) 01:38:46.754116 run osmo-hlr_10.42.42.2(pid=7904): stderr: | 20221209013843666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013843666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013843666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013843667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013843667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013843667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013843679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013843688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013843688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013843688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:46.806865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7903): Terminating (SIGTERM) 01:38:46.849282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7906): Terminating (SIGTERM) 01:38:46.891888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7909): Terminating (SIGTERM) 01:38:46.935536 --- ParallelTerminationStrategy: PID 7903 died... 01:38:46.955722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7903): Terminated: ok {rc=0} 01:38:47.004860 --- ParallelTerminationStrategy: PID 7906 died... 01:38:47.024660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7906): Terminated: ok {rc=0} 01:38:47.072772 --- ParallelTerminationStrategy: PID 7909 died... 01:38:47.092748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7909): Terminated: ok {rc=0} 01:38:47.181767 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:38:48.270061 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:48.282345 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:38:48.331759 tst ping_idle_ping.py: using LAC 18173 01:38:48.456888 tst ping_idle_ping.py: using RAC 68 01:38:48.581033 tst ping_idle_ping.py: using CellId 18173 01:38:48.706709 tst ping_idle_ping.py: using BVCI 18174 01:38:48.822773 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:48.834303 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:48.845535 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:48.856747 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:48.867936 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:48.879481 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:48.891388 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:48.902717 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:49.021053 tst ping_idle_ping.py:24: start network... 01:38:49.235379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:49.729091 run create_hlr_db(pid=7911): Launched 01:38:49.858733 bus /gobi_6: Setting Powered False 01:38:50.922569 run create_hlr_db(pid=7911): Terminated: ok {rc=0} 01:38:51.348347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7913): Launched 01:38:51.645524 run osmo-hlr_10.42.42.2(pid=7914): Launched 01:38:51.761688 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:52.287981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7916): Launched 01:38:52.585384 run osmo-stp_10.42.42.5(pid=7917): Launched 01:38:52.699631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:53.213705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7919): Launched 01:38:53.327731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:53.579015 run patchelf(pid=7920): Launched 01:38:53.744659 run osmo-stp_10.42.42.5(pid=7917): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7917)] 01:38:53.870636 run osmo-stp_10.42.42.5(pid=7917): stdout: | (launched: 2022-12-09_01:38:52.530806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:53.998507 run osmo-stp_10.42.42.5(pid=7917): stderr: | 20221209013852700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013852700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013852700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013852701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013852701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013852701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013852702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:54.126580 run osmo-stp_10.42.42.5(pid=7917): stdout: | (launched: 2022-12-09_01:38:52.530806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:54.248467 run osmo-stp_10.42.42.5(pid=7917): stderr: | 20221209013852700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013852700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013852700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013852701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013852701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013852701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013852702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:54.392711 run patchelf(pid=7920): Terminating (SIGINT) 01:38:54.559556 run patchelf(pid=7920): Terminated: ok {rc=0} 01:38:54.680202 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7917): Process ended prematurely: osmo-stp_10.42.42.5(pid=7917) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7917)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 01:38:54.689287 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:38:54.716651 run osmo-hlr_10.42.42.2(pid=7914): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7914)] 01:38:54.764586 run osmo-hlr_10.42.42.2(pid=7914): stdout: | (launched: 2022-12-09_01:38:51.590678) 01:38:54.814290 run osmo-hlr_10.42.42.2(pid=7914): stderr: | 20221209013851767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013851767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013851767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013851767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013851767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013851767 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013851779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013851789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013851790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013851790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:54.864521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7913): Terminating (SIGTERM) 01:38:54.904597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7916): Terminating (SIGTERM) 01:38:54.944605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7919): Terminating (SIGTERM) 01:38:54.984928 --- ParallelTerminationStrategy: PID 7913 died... 01:38:55.003985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7913): Terminated: ok {rc=0} 01:38:55.048334 --- ParallelTerminationStrategy: PID 7916 died... 01:38:55.067043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7916): Terminated: ok {rc=0} 01:38:55.111185 --- ParallelTerminationStrategy: PID 7919 died... 01:38:55.129701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7919): Terminated: ok {rc=0} 01:38:55.213382 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:38:56.507884 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:38:56.513820 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:38:56.542888 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:38:56.580937 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:38:56.666625 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:38:56.695469 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:38:56.733495 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:38:57.329545 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:38:57.378461 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:57.389550 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:38:57.454113 tst cs_paging_gprs_active.py: using LAC 18174 01:38:57.573143 tst cs_paging_gprs_active.py: using RAC 69 01:38:57.694270 tst cs_paging_gprs_active.py: using CellId 18174 01:38:57.817436 tst cs_paging_gprs_active.py: using BVCI 18175 01:38:57.928546 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:57.939608 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:57.950461 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:57.961619 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:57.972663 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:57.983799 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:57.994999 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:58.006029 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:58.017262 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:58.137569 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:58.254952 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:38:58.458465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:58.762597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7926): Launched 01:38:59.027421 run iperf3-srv_10.42.42.10(pid=7927): Launched 01:38:59.141490 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:38:59.343873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:59.648579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7928): Launched 01:38:59.914116 run iperf3-srv_10.42.42.10(pid=7929): Launched 01:39:00.028014 tst cs_paging_gprs_active.py:38: start network... 01:39:00.231658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:00.702203 run create_hlr_db(pid=7930): Launched 01:39:00.819096 bus /gobi_6: Setting Powered False 01:39:01.886111 run create_hlr_db(pid=7930): Terminated: ok {rc=0} 01:39:02.346539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7932): Launched 01:39:02.670543 run osmo-hlr_10.42.42.2(pid=7933): Launched 01:39:02.793955 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:03.331614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7935): Launched 01:39:03.635146 run osmo-stp_10.42.42.5(pid=7936): Launched 01:39:03.751508 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:04.274973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7938): Launched 01:39:04.391914 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:04.648418 run patchelf(pid=7939): Launched 01:39:04.819973 run osmo-stp_10.42.42.5(pid=7936): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7936)] 01:39:04.948871 run osmo-stp_10.42.42.5(pid=7936): stdout: | (launched: 2022-12-09_01:39:03.579785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:05.079935 run osmo-stp_10.42.42.5(pid=7936): stderr: | 20221209013903750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013903750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013903750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013903750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013903751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013903751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013903751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:05.210927 run osmo-stp_10.42.42.5(pid=7936): stdout: | (launched: 2022-12-09_01:39:03.579785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:05.335412 run osmo-stp_10.42.42.5(pid=7936): stderr: | 20221209013903750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013903750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013903750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013903750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013903751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013903751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013903751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:05.482807 run patchelf(pid=7939): Terminating (SIGINT) 01:39:05.653937 run patchelf(pid=7939): Terminated: ok {rc=0} 01:39:05.777494 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7936): Process ended prematurely: osmo-stp_10.42.42.5(pid=7936) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7936)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:39:05.786801 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 01:39:05.814755 run osmo-hlr_10.42.42.2(pid=7933): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7933)] 01:39:05.862755 run osmo-hlr_10.42.42.2(pid=7933): stdout: | (launched: 2022-12-09_01:39:02.611601) 01:39:05.912600 run osmo-hlr_10.42.42.2(pid=7933): stderr: | 20221209013902810 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013902810 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013902811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013902811 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013902811 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013902811 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013902823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013902832 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013902832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013902832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:05.962800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7926): Terminating (SIGTERM) 01:39:06.003016 run iperf3-srv_10.42.42.10(pid=7927): Terminating (SIGTERM) 01:39:06.043040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7928): Terminating (SIGTERM) 01:39:06.083065 run iperf3-srv_10.42.42.10(pid=7929): Terminating (SIGTERM) 01:39:06.123219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7932): Terminating (SIGTERM) 01:39:06.163386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7935): Terminating (SIGTERM) 01:39:06.203378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7938): Terminating (SIGTERM) 01:39:06.243503 --- ParallelTerminationStrategy: PID 7926 died... 01:39:06.262799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7926): Terminated: ok {rc=0} 01:39:06.307396 --- ParallelTerminationStrategy: PID 7927 died... 01:39:06.325960 run iperf3-srv_10.42.42.10(pid=7927): Terminated {rc=256} 01:39:06.370135 --- ParallelTerminationStrategy: PID 7928 died... 01:39:06.388620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7928): Terminated: ok {rc=0} 01:39:06.432552 --- ParallelTerminationStrategy: PID 7929 died... 01:39:06.451068 run iperf3-srv_10.42.42.10(pid=7929): Terminated {rc=256} 01:39:06.495242 --- ParallelTerminationStrategy: PID 7932 died... 01:39:06.513942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7932): Terminated: ok {rc=0} 01:39:06.558158 --- ParallelTerminationStrategy: PID 7935 died... 01:39:06.576775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7935): Terminated: ok {rc=0} 01:39:06.621033 --- ParallelTerminationStrategy: PID 7938 died... 01:39:06.639579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7938): Terminated: ok {rc=0} 01:39:06.725304 bus /gobi_0: Setting Powered False 01:39:07.828898 bus /gobi_0: Setting Powered False 01:39:08.943430 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:39:10.086267 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:10.098105 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:39:10.170745 tst iperf3.py: using LAC 18175 01:39:10.288373 tst iperf3.py: using RAC 70 01:39:10.404891 tst iperf3.py: using CellId 18175 01:39:10.522195 tst iperf3.py: using BVCI 18176 01:39:10.631219 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:10.642346 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:10.653308 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:10.664503 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:10.675583 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:10.686725 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:10.697996 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:10.708919 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:10.720590 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:39:10.840488 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:39:11.051273 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:11.355558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7940): Launched 01:39:11.619362 run iperf3-srv_10.42.42.10(pid=7941): Launched 01:39:11.733481 tst iperf3.py:8: start network... 01:39:11.936270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:12.403319 run create_hlr_db(pid=7942): Launched 01:39:12.518801 bus /gobi_6: Setting Powered False 01:39:13.582907 run create_hlr_db(pid=7942): Terminated: ok {rc=0} 01:39:14.015992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7944): Launched 01:39:14.320024 run osmo-hlr_10.42.42.2(pid=7945): Launched 01:39:14.436415 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:14.965448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7947): Launched 01:39:15.267423 run osmo-stp_10.42.42.5(pid=7948): Launched 01:39:15.382399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:15.909078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7950): Launched 01:39:16.061440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:16.351536 run patchelf(pid=7951): Launched 01:39:16.548487 run osmo-stp_10.42.42.5(pid=7948): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7948)] 01:39:16.680045 run osmo-stp_10.42.42.5(pid=7948): stdout: | (launched: 2022-12-09_01:39:15.212284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:16.813833 run osmo-stp_10.42.42.5(pid=7948): stderr: | 20221209013915383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013915383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013915383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013915384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013915384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013915384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013915384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:16.968903 run osmo-stp_10.42.42.5(pid=7948): stdout: | (launched: 2022-12-09_01:39:15.212284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:17.099127 run osmo-stp_10.42.42.5(pid=7948): stderr: | 20221209013915383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013915383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013915383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013915384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013915384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013915384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013915384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:17.252087 run patchelf(pid=7951): Terminating (SIGINT) 01:39:17.425155 run patchelf(pid=7951): Terminated: ok {rc=0} 01:39:17.548406 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7948): Process ended prematurely: osmo-stp_10.42.42.5(pid=7948) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7948)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 01:39:17.558115 tst iperf3.py:8: Test FAILED (7.5 sec) 01:39:17.586120 run osmo-hlr_10.42.42.2(pid=7945): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7945)] 01:39:17.634363 run osmo-hlr_10.42.42.2(pid=7945): stdout: | (launched: 2022-12-09_01:39:14.264488) 01:39:17.684253 run osmo-hlr_10.42.42.2(pid=7945): stderr: | 20221209013914438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013914438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013914438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013914438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013914438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013914438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013914450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013914461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013914461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013914461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:17.734562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7940): Terminating (SIGTERM) 01:39:17.774623 run iperf3-srv_10.42.42.10(pid=7941): Terminating (SIGTERM) 01:39:17.814560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7944): Terminating (SIGTERM) 01:39:17.854648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7947): Terminating (SIGTERM) 01:39:17.894519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7950): Terminating (SIGTERM) 01:39:17.934746 --- ParallelTerminationStrategy: PID 7940 died... 01:39:17.954012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7940): Terminated: ok {rc=0} 01:39:17.998668 --- ParallelTerminationStrategy: PID 7941 died... 01:39:18.017233 run iperf3-srv_10.42.42.10(pid=7941): Terminated {rc=256} 01:39:18.061610 --- ParallelTerminationStrategy: PID 7944 died... 01:39:18.080303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7944): Terminated: ok {rc=0} 01:39:18.124747 --- ParallelTerminationStrategy: PID 7947 died... 01:39:18.143368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7947): Terminated: ok {rc=0} 01:39:18.187609 --- ParallelTerminationStrategy: PID 7950 died... 01:39:18.206340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7950): Terminated: ok {rc=0} 01:39:18.292277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:39:19.438854 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:19.453841 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:39:19.517443 tst iperf3m4.py: using LAC 18176 01:39:19.645401 tst iperf3m4.py: using RAC 71 01:39:19.771962 tst iperf3m4.py: using CellId 18176 01:39:19.900501 tst iperf3m4.py: using BVCI 18177 01:39:20.018663 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.030305 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.041589 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.053430 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.065184 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.076866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.088796 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.100551 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.112608 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:39:20.233434 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:39:20.353607 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:39:20.468572 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:39:20.587771 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:39:20.791617 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:21.095505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7952): Launched 01:39:21.359590 run iperf3-srv_10.42.42.10(pid=7953): Launched 01:39:21.473876 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:39:21.675770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:21.979007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7954): Launched 01:39:22.242364 run iperf3-srv_10.42.42.10(pid=7955): Launched 01:39:22.357807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:39:22.561079 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:22.863696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7956): Launched 01:39:23.126883 run iperf3-srv_10.42.42.10(pid=7957): Launched 01:39:23.240569 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:39:23.442794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:23.746442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7958): Launched 01:39:24.010141 run iperf3-srv_10.42.42.10(pid=7959): Launched 01:39:24.123603 tst iperf3m4.py:8: start network... 01:39:24.325148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:24.791501 run create_hlr_db(pid=7960): Launched 01:39:24.907216 bus /gobi_6: Setting Powered False 01:39:25.967159 run create_hlr_db(pid=7960): Terminated: ok {rc=0} 01:39:26.387391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Launched 01:39:26.689292 run osmo-hlr_10.42.42.2(pid=7963): Launched 01:39:26.804331 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:27.323293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Launched 01:39:27.626238 run osmo-stp_10.42.42.5(pid=7966): Launched 01:39:27.740852 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:28.275846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7968): Launched 01:39:28.392019 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:28.647437 run patchelf(pid=7969): Launched 01:39:28.815748 run osmo-stp_10.42.42.5(pid=7966): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] 01:39:28.944254 run osmo-stp_10.42.42.5(pid=7966): stdout: | (launched: 2022-12-09_01:39:27.570385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:29.073635 run osmo-stp_10.42.42.5(pid=7966): stderr: | 20221209013927741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013927741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013927742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013927742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013927742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013927743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013927743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:29.203393 run osmo-stp_10.42.42.5(pid=7966): stdout: | (launched: 2022-12-09_01:39:27.570385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:29.326779 run osmo-stp_10.42.42.5(pid=7966): stderr: | 20221209013927741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013927741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013927742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013927742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013927742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013927743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013927743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:29.473303 run patchelf(pid=7969): Terminating (SIGINT) 01:39:29.642891 run patchelf(pid=7969): Terminated: ok {rc=0} 01:39:29.765338 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7966): Process ended prematurely: osmo-stp_10.42.42.5(pid=7966) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:39:29.774922 tst iperf3m4.py:8: Test FAILED (10.4 sec) 01:39:29.803414 run osmo-hlr_10.42.42.2(pid=7963): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7963)] 01:39:29.851452 run osmo-hlr_10.42.42.2(pid=7963): stdout: | (launched: 2022-12-09_01:39:26.633845) 01:39:29.901271 run osmo-hlr_10.42.42.2(pid=7963): stderr: | 20221209013926805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013926805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013926805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013926805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013926805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013926806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013926818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013926826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013926827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013926827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:29.951189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7952): Terminating (SIGTERM) 01:39:29.991069 run iperf3-srv_10.42.42.10(pid=7953): Terminating (SIGTERM) 01:39:30.030934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7954): Terminating (SIGTERM) 01:39:30.070856 run iperf3-srv_10.42.42.10(pid=7955): Terminating (SIGTERM) 01:39:30.110592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7956): Terminating (SIGTERM) 01:39:30.150334 run iperf3-srv_10.42.42.10(pid=7957): Terminating (SIGTERM) 01:39:30.189951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7958): Terminating (SIGTERM) 01:39:30.229772 run iperf3-srv_10.42.42.10(pid=7959): Terminating (SIGTERM) 01:39:30.269275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Terminating (SIGTERM) 01:39:30.309446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Terminating (SIGTERM) 01:39:30.349133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7968): Terminating (SIGTERM) 01:39:30.388927 --- ParallelTerminationStrategy: PID 7952 died... 01:39:30.407882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7952): Terminated: ok {rc=0} 01:39:30.452481 --- ParallelTerminationStrategy: PID 7953 died... 01:39:30.470994 run iperf3-srv_10.42.42.10(pid=7953): Terminated {rc=256} 01:39:30.515173 --- ParallelTerminationStrategy: PID 7954 died... 01:39:30.533620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7954): Terminated: ok {rc=0} 01:39:30.577753 --- ParallelTerminationStrategy: PID 7955 died... 01:39:30.596336 run iperf3-srv_10.42.42.10(pid=7955): Terminated {rc=256} 01:39:30.640513 --- ParallelTerminationStrategy: PID 7956 died... 01:39:30.659067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7956): Terminated: ok {rc=0} 01:39:30.703340 --- ParallelTerminationStrategy: PID 7957 died... 01:39:30.721848 run iperf3-srv_10.42.42.10(pid=7957): Terminated {rc=256} 01:39:30.766220 --- ParallelTerminationStrategy: PID 7958 died... 01:39:30.785005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7958): Terminated: ok {rc=0} 01:39:30.829638 --- ParallelTerminationStrategy: PID 7959 died... 01:39:30.848698 run iperf3-srv_10.42.42.10(pid=7959): Terminated {rc=256} 01:39:30.893630 --- ParallelTerminationStrategy: PID 7962 died... 01:39:30.912775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Terminated: ok {rc=0} 01:39:30.957946 --- ParallelTerminationStrategy: PID 7965 died... 01:39:30.977092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Terminated: ok {rc=0} 01:39:31.022289 --- ParallelTerminationStrategy: PID 7968 died... 01:39:31.041491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7968): Terminated: ok {rc=0} 01:39:31.127967 bus /gobi_4: Setting Powered False 01:39:32.239543 bus /gobi_4: Setting Powered False 01:39:33.360370 bus /gobi_1: Setting Powered False 01:39:34.460021 bus /gobi_1: Setting Powered False 01:39:35.575826 bus /gobi_0: Setting Powered False 01:39:36.674503 bus /gobi_0: Setting Powered False 01:39:37.792086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:39:38.894768 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:38.906450 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:39:38.972234 tst ping.py: using LAC 18177 01:39:39.088516 tst ping.py: using RAC 72 01:39:39.204749 tst ping.py: using CellId 18177 01:39:39.330515 tst ping.py: using BVCI 18178 01:39:39.444917 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:39.456771 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:39.468423 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:39.480186 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:39.491856 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:39.503652 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:39.515279 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:39.527213 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:39:39.640909 tst ping.py:19: start network... 01:39:39.840648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:40.300011 run create_hlr_db(pid=7970): Launched 01:39:40.416089 bus /gobi_6: Setting Powered False 01:39:41.475972 run create_hlr_db(pid=7970): Terminated: ok {rc=0} 01:39:41.909441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7972): Launched 01:39:42.228745 run osmo-hlr_10.42.42.2(pid=7973): Launched 01:39:42.352534 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:42.903999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7975): Launched 01:39:43.222268 run osmo-stp_10.42.42.5(pid=7976): Launched 01:39:43.344499 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:43.890361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7978): Launched 01:39:44.013218 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:44.281089 run patchelf(pid=7979): Launched 01:39:44.457317 run osmo-stp_10.42.42.5(pid=7976): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7976)] 01:39:44.592267 run osmo-stp_10.42.42.5(pid=7976): stdout: | (launched: 2022-12-09_01:39:43.164473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:44.728265 run osmo-stp_10.42.42.5(pid=7976): stderr: | 20221209013943355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013943355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013943356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013943356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013943357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013943357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013943357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:44.864061 run osmo-stp_10.42.42.5(pid=7976): stdout: | (launched: 2022-12-09_01:39:43.164473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:44.994623 run osmo-stp_10.42.42.5(pid=7976): stderr: | 20221209013943355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013943355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013943356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013943356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013943357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013943357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013943357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:45.148218 run patchelf(pid=7979): Terminating (SIGINT) 01:39:45.325915 run patchelf(pid=7979): Terminated: ok {rc=0} 01:39:45.453704 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7976): Process ended prematurely: osmo-stp_10.42.42.5(pid=7976) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7976)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 01:39:45.463093 tst ping.py:22: Test FAILED (6.6 sec) 01:39:45.491291 run osmo-hlr_10.42.42.2(pid=7973): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7973)] 01:39:45.541339 run osmo-hlr_10.42.42.2(pid=7973): stdout: | (launched: 2022-12-09_01:39:42.170703) 01:39:45.593381 run osmo-hlr_10.42.42.2(pid=7973): stderr: | 20221209013942368 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013942368 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013942368 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013942368 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013942368 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013942368 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013942380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013942388 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013942389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013942389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:45.645529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7972): Terminating (SIGTERM) 01:39:45.687362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7975): Terminating (SIGTERM) 01:39:45.729141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7978): Terminating (SIGTERM) 01:39:45.771171 --- ParallelTerminationStrategy: PID 7972 died... 01:39:45.791298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7972): Terminated: ok {rc=0} 01:39:45.848144 --- ParallelTerminationStrategy: PID 7975 died... 01:39:45.885703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7975): Terminated: ok {rc=0} 01:39:45.942976 --- ParallelTerminationStrategy: PID 7978 died... 01:39:45.962982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7978): Terminated: ok {rc=0} 01:39:46.050941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:39:47.136418 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:47.149417 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:39:47.221052 tst ping_idle_ping.py: using LAC 18178 01:39:47.340342 tst ping_idle_ping.py: using RAC 73 01:39:47.457665 tst ping_idle_ping.py: using CellId 18178 01:39:47.582759 tst ping_idle_ping.py: using BVCI 18179 01:39:47.698041 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:47.709802 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:47.721205 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:47.732533 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:47.743984 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:47.755515 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:47.767469 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:47.779207 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:39:47.895376 tst ping_idle_ping.py:24: start network... 01:39:48.094487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:48.555551 run create_hlr_db(pid=7980): Launched 01:39:48.671432 bus /gobi_6: Setting Powered False 01:39:49.732214 run create_hlr_db(pid=7980): Terminated: ok {rc=0} 01:39:50.148892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7982): Launched 01:39:50.447233 run osmo-hlr_10.42.42.2(pid=7983): Launched 01:39:50.562056 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:51.072436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7985): Launched 01:39:51.370187 run osmo-stp_10.42.42.5(pid=7986): Launched 01:39:51.484078 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:51.999360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7988): Launched 01:39:52.113304 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:52.364887 run patchelf(pid=7989): Launched 01:39:52.531021 run osmo-stp_10.42.42.5(pid=7986): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7986)] 01:39:52.658111 run osmo-stp_10.42.42.5(pid=7986): stdout: | (launched: 2022-12-09_01:39:51.315118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:52.786154 run osmo-stp_10.42.42.5(pid=7986): stderr: | 20221209013951483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013951483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013951483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013951484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013951484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013951484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013951484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:52.914309 run osmo-stp_10.42.42.5(pid=7986): stdout: | (launched: 2022-12-09_01:39:51.315118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:53.036278 run osmo-stp_10.42.42.5(pid=7986): stderr: | 20221209013951483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209013951483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209013951483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209013951484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209013951484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209013951484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209013951484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:53.180636 run patchelf(pid=7989): Terminating (SIGINT) 01:39:53.347879 run patchelf(pid=7989): Terminated: ok {rc=0} 01:39:53.468385 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7986): Process ended prematurely: osmo-stp_10.42.42.5(pid=7986) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7986)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:39:53.477391 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 01:39:53.504416 run osmo-hlr_10.42.42.2(pid=7983): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7983)] 01:39:53.552796 run osmo-hlr_10.42.42.2(pid=7983): stdout: | (launched: 2022-12-09_01:39:50.392535) 01:39:53.602647 run osmo-hlr_10.42.42.2(pid=7983): stderr: | 20221209013950568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209013950568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209013950568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209013950568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209013950568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209013950568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209013950584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209013950594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209013950594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209013950594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:53.652851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7982): Terminating (SIGTERM) 01:39:53.692986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7985): Terminating (SIGTERM) 01:39:53.733142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7988): Terminating (SIGTERM) 01:39:53.773456 --- ParallelTerminationStrategy: PID 7982 died... 01:39:53.792695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7982): Terminated: ok {rc=0} 01:39:53.837474 --- ParallelTerminationStrategy: PID 7985 died... 01:39:53.855846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7985): Terminated: ok {rc=0} 01:39:53.900292 --- ParallelTerminationStrategy: PID 7988 died... 01:39:53.918949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7988): Terminated: ok {rc=0} 01:39:54.005623 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:39:55.305049 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:39:55.311464 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:39:55.341705 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:39:55.380376 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:39:55.466002 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:39:55.494670 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:39:55.532600 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:39:56.135349 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:39:56.189434 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:56.201172 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:39:56.270800 tst cs_paging_gprs_active.py: using LAC 18179 01:39:56.399519 tst cs_paging_gprs_active.py: using RAC 74 01:39:56.519949 tst cs_paging_gprs_active.py: using CellId 18179 01:39:56.639823 tst cs_paging_gprs_active.py: using BVCI 18180 01:39:56.759997 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:56.771638 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:56.783022 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:56.794518 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:56.806110 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:56.817409 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:56.829007 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:56.840298 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:56.851830 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:56.974649 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:57.092056 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:39:57.295513 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:57.598815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7995): Launched 01:39:57.862584 run iperf3-srv_10.42.42.10(pid=7996): Launched 01:39:57.976587 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:39:58.179344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:58.483268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7997): Launched 01:39:58.748354 run iperf3-srv_10.42.42.10(pid=7998): Launched 01:39:58.862282 tst cs_paging_gprs_active.py:38: start network... 01:39:59.064803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:59.535696 run create_hlr_db(pid=7999): Launched 01:39:59.652374 bus /gobi_6: Setting Powered False 01:40:00.712174 run create_hlr_db(pid=7999): Terminated: ok {rc=0} 01:40:01.169698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8004): Launched 01:40:01.511819 run osmo-hlr_10.42.42.2(pid=8005): Launched 01:40:01.760491 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:02.529005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8007): Launched 01:40:02.833741 run osmo-stp_10.42.42.5(pid=8008): Launched 01:40:02.950926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:03.474849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8010): Launched 01:40:03.593909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:03.857362 run patchelf(pid=8011): Launched 01:40:04.027186 run osmo-stp_10.42.42.5(pid=8008): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8008)] 01:40:04.156324 run osmo-stp_10.42.42.5(pid=8008): stdout: | (launched: 2022-12-09_01:40:02.778073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:04.287062 run osmo-stp_10.42.42.5(pid=8008): stderr: | 20221209014002948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014002948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014002948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014002949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014002949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014002949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014002949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:04.418108 run osmo-stp_10.42.42.5(pid=8008): stdout: | (launched: 2022-12-09_01:40:02.778073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:04.542692 run osmo-stp_10.42.42.5(pid=8008): stderr: | 20221209014002948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014002948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014002948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014002949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014002949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014002949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014002949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:04.690304 run patchelf(pid=8011): Terminating (SIGINT) 01:40:04.862283 run patchelf(pid=8011): Terminated: ok {rc=0} 01:40:04.986115 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8008): Process ended prematurely: osmo-stp_10.42.42.5(pid=8008) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8008)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:40:04.995685 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:40:05.023779 run osmo-hlr_10.42.42.2(pid=8005): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8005)] 01:40:05.071621 run osmo-hlr_10.42.42.2(pid=8005): stdout: | (launched: 2022-12-09_01:40:01.449481) 01:40:05.121569 run osmo-hlr_10.42.42.2(pid=8005): stderr: | 20221209014001752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014001752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014001752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014001753 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014001753 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014001753 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014001771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014001789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014001789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014001790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:05.172016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7995): Terminating (SIGTERM) 01:40:05.212430 run iperf3-srv_10.42.42.10(pid=7996): Terminating (SIGTERM) 01:40:05.252872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7997): Terminating (SIGTERM) 01:40:05.293924 run iperf3-srv_10.42.42.10(pid=7998): Terminating (SIGTERM) 01:40:05.334104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8004): Terminating (SIGTERM) 01:40:05.374317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8007): Terminating (SIGTERM) 01:40:05.414660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8010): Terminating (SIGTERM) 01:40:05.455055 --- ParallelTerminationStrategy: PID 7995 died... 01:40:05.474276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7995): Terminated: ok {rc=0} 01:40:05.519042 --- ParallelTerminationStrategy: PID 7996 died... 01:40:05.537860 run iperf3-srv_10.42.42.10(pid=7996): Terminated {rc=256} 01:40:05.583107 --- ParallelTerminationStrategy: PID 7997 died... 01:40:05.601911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7997): Terminated: ok {rc=0} 01:40:05.646649 --- ParallelTerminationStrategy: PID 7998 died... 01:40:05.665496 run iperf3-srv_10.42.42.10(pid=7998): Terminated {rc=256} 01:40:05.710071 --- ParallelTerminationStrategy: PID 8004 died... 01:40:05.728787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8004): Terminated: ok {rc=0} 01:40:05.773275 --- ParallelTerminationStrategy: PID 8007 died... 01:40:05.792029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8007): Terminated: ok {rc=0} 01:40:05.836741 --- ParallelTerminationStrategy: PID 8010 died... 01:40:05.855586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8010): Terminated: ok {rc=0} 01:40:05.939489 bus /gobi_0: Setting Powered False 01:40:07.039331 bus /gobi_0: Setting Powered False 01:40:08.157192 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:40:09.300292 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:09.311976 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:40:09.377366 tst iperf3.py: using LAC 18180 01:40:09.497373 tst iperf3.py: using RAC 75 01:40:09.616910 tst iperf3.py: using CellId 18180 01:40:09.736054 tst iperf3.py: using BVCI 18181 01:40:09.845790 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:09.856789 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:09.867737 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:09.878822 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:09.889905 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:09.900943 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:09.912201 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:09.923148 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:09.934431 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:10.052392 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:40:10.272143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:40:10.596031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8012): Launched 01:40:10.878204 run iperf3-srv_10.42.42.10(pid=8013): Launched 01:40:11.001942 tst iperf3.py:8: start network... 01:40:11.211276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:11.679455 run create_hlr_db(pid=8014): Launched 01:40:11.794934 bus /gobi_6: Setting Powered False 01:40:12.854368 run create_hlr_db(pid=8014): Terminated: ok {rc=0} 01:40:13.295028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8016): Launched 01:40:13.619740 run osmo-hlr_10.42.42.2(pid=8017): Launched 01:40:13.746228 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:14.305122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8019): Launched 01:40:14.629067 run osmo-stp_10.42.42.5(pid=8020): Launched 01:40:14.754664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:15.314851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8022): Launched 01:40:15.438427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:15.711588 run patchelf(pid=8023): Launched 01:40:15.897878 run osmo-stp_10.42.42.5(pid=8020): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8020)] 01:40:16.040015 run osmo-stp_10.42.42.5(pid=8020): stdout: | (launched: 2022-12-09_01:40:14.570129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:16.175501 run osmo-stp_10.42.42.5(pid=8020): stderr: | 20221209014014763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014014763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014014763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014014764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014014764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014014764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014014764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:16.309897 run osmo-stp_10.42.42.5(pid=8020): stdout: | (launched: 2022-12-09_01:40:14.570129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:16.439625 run osmo-stp_10.42.42.5(pid=8020): stderr: | 20221209014014763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014014763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014014763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014014764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014014764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014014764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014014764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:16.601447 run patchelf(pid=8023): Terminating (SIGINT) 01:40:16.779233 run patchelf(pid=8023): Terminated: ok {rc=0} 01:40:16.906154 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8020): Process ended prematurely: osmo-stp_10.42.42.5(pid=8020) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8020)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 01:40:16.917087 tst iperf3.py:8: Test FAILED (7.7 sec) 01:40:16.949050 run osmo-hlr_10.42.42.2(pid=8017): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8017)] 01:40:17.000696 run osmo-hlr_10.42.42.2(pid=8017): stdout: | (launched: 2022-12-09_01:40:13.561206) 01:40:17.054217 run osmo-hlr_10.42.42.2(pid=8017): stderr: | 20221209014013760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014013760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014013761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014013761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014013761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014013761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014013772 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014013780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014013780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014013780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:17.107453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8012): Terminating (SIGTERM) 01:40:17.151855 run iperf3-srv_10.42.42.10(pid=8013): Terminating (SIGTERM) 01:40:17.197273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8016): Terminating (SIGTERM) 01:40:17.243547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8019): Terminating (SIGTERM) 01:40:17.286907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8022): Terminating (SIGTERM) 01:40:17.329912 --- ParallelTerminationStrategy: PID 8012 died... 01:40:17.350028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8012): Terminated: ok {rc=0} 01:40:17.396598 --- ParallelTerminationStrategy: PID 8013 died... 01:40:17.416134 run iperf3-srv_10.42.42.10(pid=8013): Terminated {rc=256} 01:40:17.462778 --- ParallelTerminationStrategy: PID 8016 died... 01:40:17.482654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8016): Terminated: ok {rc=0} 01:40:17.529648 --- ParallelTerminationStrategy: PID 8019 died... 01:40:17.549560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8019): Terminated: ok {rc=0} 01:40:17.596173 --- ParallelTerminationStrategy: PID 8022 died... 01:40:17.616135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8022): Terminated: ok {rc=0} 01:40:17.704825 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:40:18.850959 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:18.862936 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:40:18.932037 tst iperf3m4.py: using LAC 18181 01:40:19.059925 tst iperf3m4.py: using RAC 76 01:40:19.186303 tst iperf3m4.py: using CellId 18181 01:40:19.314597 tst iperf3m4.py: using BVCI 18182 01:40:19.433385 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.445073 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.456609 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.468074 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.479473 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.490850 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.502517 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.513888 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.525538 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:19.640392 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:19.762514 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:19.879541 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:20.000393 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:40:20.219395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:40:20.544303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8024): Launched 01:40:20.826148 run iperf3-srv_10.42.42.10(pid=8025): Launched 01:40:20.950493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:40:21.169016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:40:21.494367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8026): Launched 01:40:21.776483 run iperf3-srv_10.42.42.10(pid=8027): Launched 01:40:21.898005 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:40:22.116474 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:40:22.441568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8028): Launched 01:40:22.723511 run iperf3-srv_10.42.42.10(pid=8029): Launched 01:40:22.845274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:40:23.064862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:40:23.390709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8030): Launched 01:40:23.672136 run iperf3-srv_10.42.42.10(pid=8031): Launched 01:40:23.793922 tst iperf3m4.py:8: start network... 01:40:24.013301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:24.515872 run create_hlr_db(pid=8032): Launched 01:40:24.650062 bus /gobi_6: Setting Powered False 01:40:25.714035 run create_hlr_db(pid=8032): Terminated: ok {rc=0} 01:40:26.145984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8034): Launched 01:40:26.449509 run osmo-hlr_10.42.42.2(pid=8035): Launched 01:40:26.567441 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:27.099143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8037): Launched 01:40:27.403425 run osmo-stp_10.42.42.5(pid=8038): Launched 01:40:27.520461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:28.041958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8040): Launched 01:40:28.159950 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:28.415622 run patchelf(pid=8041): Launched 01:40:28.584648 run osmo-stp_10.42.42.5(pid=8038): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8038)] 01:40:28.713119 run osmo-stp_10.42.42.5(pid=8038): stdout: | (launched: 2022-12-09_01:40:27.347850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:28.842807 run osmo-stp_10.42.42.5(pid=8038): stderr: | 20221209014027513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014027513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014027514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014027514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014027514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014027515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014027515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:28.973370 run osmo-stp_10.42.42.5(pid=8038): stdout: | (launched: 2022-12-09_01:40:27.347850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:29.097120 run osmo-stp_10.42.42.5(pid=8038): stderr: | 20221209014027513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014027513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014027514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014027514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014027514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014027515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014027515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:29.243593 run patchelf(pid=8041): Terminating (SIGINT) 01:40:29.413630 run patchelf(pid=8041): Terminated: ok {rc=0} 01:40:29.536275 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8038): Process ended prematurely: osmo-stp_10.42.42.5(pid=8038) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8038)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:40:29.545964 tst iperf3m4.py:8: Test FAILED (10.7 sec) 01:40:29.573622 run osmo-hlr_10.42.42.2(pid=8035): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8035)] 01:40:29.622068 run osmo-hlr_10.42.42.2(pid=8035): stdout: | (launched: 2022-12-09_01:40:26.394027) 01:40:29.671892 run osmo-hlr_10.42.42.2(pid=8035): stderr: | 20221209014026567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014026567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014026567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014026567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014026567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014026567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014026586 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014026595 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014026595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014026596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:29.722079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8024): Terminating (SIGTERM) 01:40:29.762175 run iperf3-srv_10.42.42.10(pid=8025): Terminating (SIGTERM) 01:40:29.802070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8026): Terminating (SIGTERM) 01:40:29.841972 run iperf3-srv_10.42.42.10(pid=8027): Terminating (SIGTERM) 01:40:29.883121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8028): Terminating (SIGTERM) 01:40:29.923680 run iperf3-srv_10.42.42.10(pid=8029): Terminating (SIGTERM) 01:40:29.963515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8030): Terminating (SIGTERM) 01:40:30.003471 run iperf3-srv_10.42.42.10(pid=8031): Terminating (SIGTERM) 01:40:30.043236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8034): Terminating (SIGTERM) 01:40:30.083068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8037): Terminating (SIGTERM) 01:40:30.123133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8040): Terminating (SIGTERM) 01:40:30.163071 --- ParallelTerminationStrategy: PID 8024 died... 01:40:30.182139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8024): Terminated: ok {rc=0} 01:40:30.226898 --- ParallelTerminationStrategy: PID 8025 died... 01:40:30.245628 run iperf3-srv_10.42.42.10(pid=8025): Terminated {rc=256} 01:40:30.289860 --- ParallelTerminationStrategy: PID 8026 died... 01:40:30.308520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8026): Terminated: ok {rc=0} 01:40:30.352794 --- ParallelTerminationStrategy: PID 8027 died... 01:40:30.371896 run iperf3-srv_10.42.42.10(pid=8027): Terminated {rc=256} 01:40:30.416347 --- ParallelTerminationStrategy: PID 8028 died... 01:40:30.435115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8028): Terminated: ok {rc=0} 01:40:30.480243 --- ParallelTerminationStrategy: PID 8029 died... 01:40:30.498835 run iperf3-srv_10.42.42.10(pid=8029): Terminated {rc=256} 01:40:30.542985 --- ParallelTerminationStrategy: PID 8030 died... 01:40:30.561473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8030): Terminated: ok {rc=0} 01:40:30.606314 --- ParallelTerminationStrategy: PID 8031 died... 01:40:30.624833 run iperf3-srv_10.42.42.10(pid=8031): Terminated {rc=256} 01:40:30.669051 --- ParallelTerminationStrategy: PID 8034 died... 01:40:30.687638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8034): Terminated: ok {rc=0} 01:40:30.731925 --- ParallelTerminationStrategy: PID 8037 died... 01:40:30.750686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8037): Terminated: ok {rc=0} 01:40:30.795098 --- ParallelTerminationStrategy: PID 8040 died... 01:40:30.813760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8040): Terminated: ok {rc=0} 01:40:30.920842 bus /gobi_4: Setting Powered False 01:40:32.031028 bus /gobi_4: Setting Powered False 01:40:33.163326 bus /gobi_1: Setting Powered False 01:40:34.263049 bus /gobi_1: Setting Powered False 01:40:35.378456 bus /gobi_0: Setting Powered False 01:40:36.476699 bus /gobi_0: Setting Powered False 01:40:37.594091 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:40:38.697353 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:38.709589 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:40:38.777577 tst ping.py: using LAC 18182 01:40:38.903449 tst ping.py: using RAC 77 01:40:39.028254 tst ping.py: using CellId 18182 01:40:39.156224 tst ping.py: using BVCI 18183 01:40:39.272445 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:39.284018 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:39.295370 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:39.307296 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:39.318678 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:39.330606 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:39.343629 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:39.355236 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:39.469758 tst ping.py:19: start network... 01:40:39.668292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:40.126818 run create_hlr_db(pid=8043): Launched 01:40:40.241579 bus /gobi_6: Setting Powered False 01:40:41.301274 run create_hlr_db(pid=8043): Terminated: ok {rc=0} 01:40:41.714648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8045): Launched 01:40:42.013779 run osmo-hlr_10.42.42.2(pid=8046): Launched 01:40:42.128073 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:42.644158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8048): Launched 01:40:42.940921 run osmo-stp_10.42.42.5(pid=8049): Launched 01:40:43.058015 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:43.572612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8051): Launched 01:40:43.695292 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:43.963916 run patchelf(pid=8052): Launched 01:40:44.141538 run osmo-stp_10.42.42.5(pid=8049): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8049)] 01:40:44.276061 run osmo-stp_10.42.42.5(pid=8049): stdout: | (launched: 2022-12-09_01:40:42.886442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:44.412640 run osmo-stp_10.42.42.5(pid=8049): stderr: | 20221209014043053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014043053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014043053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014043054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014043054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014043054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014043054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:44.549754 run osmo-stp_10.42.42.5(pid=8049): stdout: | (launched: 2022-12-09_01:40:42.886442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:44.679771 run osmo-stp_10.42.42.5(pid=8049): stderr: | 20221209014043053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014043053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014043053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014043054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014043054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014043054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014043054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:44.833876 run patchelf(pid=8052): Terminating (SIGINT) 01:40:45.011449 run patchelf(pid=8052): Terminated: ok {rc=0} 01:40:45.140199 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8049): Process ended prematurely: osmo-stp_10.42.42.5(pid=8049) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8049)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 01:40:45.149889 tst ping.py:22: Test FAILED (6.4 sec) 01:40:45.178029 run osmo-hlr_10.42.42.2(pid=8046): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8046)] 01:40:45.228424 run osmo-hlr_10.42.42.2(pid=8046): stdout: | (launched: 2022-12-09_01:40:41.959272) 01:40:45.280382 run osmo-hlr_10.42.42.2(pid=8046): stderr: | 20221209014042135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014042135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014042135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014042135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014042135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014042135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014042147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014042156 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014042156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014042156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:45.332729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8045): Terminating (SIGTERM) 01:40:45.374870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8048): Terminating (SIGTERM) 01:40:45.417076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8051): Terminating (SIGTERM) 01:40:45.459531 --- ParallelTerminationStrategy: PID 8045 died... 01:40:45.479814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8045): Terminated: ok {rc=0} 01:40:45.526508 --- ParallelTerminationStrategy: PID 8048 died... 01:40:45.546354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8048): Terminated: ok {rc=0} 01:40:45.592835 --- ParallelTerminationStrategy: PID 8051 died... 01:40:45.612913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8051): Terminated: ok {rc=0} 01:40:45.702664 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:40:46.788360 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:46.800867 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:40:46.874893 tst ping_idle_ping.py: using LAC 18183 01:40:47.022193 tst ping_idle_ping.py: using RAC 78 01:40:47.142234 tst ping_idle_ping.py: using CellId 18183 01:40:47.262598 tst ping_idle_ping.py: using BVCI 18184 01:40:47.372238 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:47.383428 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:47.394506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:47.406377 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:47.418051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:47.429722 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:47.441636 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:47.453384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:47.567844 tst ping_idle_ping.py:24: start network... 01:40:47.767042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:48.228907 run create_hlr_db(pid=8053): Launched 01:40:48.342862 bus /gobi_6: Setting Powered False 01:40:49.403082 run create_hlr_db(pid=8053): Terminated: ok {rc=0} 01:40:49.839957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8055): Launched 01:40:50.160552 run osmo-hlr_10.42.42.2(pid=8056): Launched 01:40:50.284119 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:50.831630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8058): Launched 01:40:51.151674 run osmo-stp_10.42.42.5(pid=8059): Launched 01:40:51.274911 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:51.825838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8061): Launched 01:40:51.948710 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:52.218743 run patchelf(pid=8062): Launched 01:40:52.397766 run osmo-stp_10.42.42.5(pid=8059): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8059)] 01:40:52.533433 run osmo-stp_10.42.42.5(pid=8059): stdout: | (launched: 2022-12-09_01:40:51.093098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:52.670588 run osmo-stp_10.42.42.5(pid=8059): stderr: | 20221209014051284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014051285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014051285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014051285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014051286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014051286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014051286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:52.807769 run osmo-stp_10.42.42.5(pid=8059): stdout: | (launched: 2022-12-09_01:40:51.093098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:52.939168 run osmo-stp_10.42.42.5(pid=8059): stderr: | 20221209014051284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014051285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014051285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014051285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014051286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014051286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014051286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:53.094118 run patchelf(pid=8062): Terminating (SIGINT) 01:40:53.273455 run patchelf(pid=8062): Terminated: ok {rc=0} 01:40:53.401892 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8059): Process ended prematurely: osmo-stp_10.42.42.5(pid=8059) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8059)] [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:40:53.411544 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:40:53.439994 run osmo-hlr_10.42.42.2(pid=8056): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8056)] 01:40:53.490337 run osmo-hlr_10.42.42.2(pid=8056): stdout: | (launched: 2022-12-09_01:40:50.102445) 01:40:53.542367 run osmo-hlr_10.42.42.2(pid=8056): stderr: | 20221209014050299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014050299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014050299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014050299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014050299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014050299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014050312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014050321 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014050321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014050321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:53.594619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8055): Terminating (SIGTERM) 01:40:53.636329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8058): Terminating (SIGTERM) 01:40:53.678263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8061): Terminating (SIGTERM) 01:40:53.720618 --- ParallelTerminationStrategy: PID 8055 died... 01:40:53.740881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8055): Terminated: ok {rc=0} 01:40:53.787601 --- ParallelTerminationStrategy: PID 8058 died... 01:40:53.807343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8058): Terminated: ok {rc=0} 01:40:53.854074 --- ParallelTerminationStrategy: PID 8061 died... 01:40:53.873985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8061): Terminated: ok {rc=0} 01:40:53.962537 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:40:55.272617 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:40:55.281496 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:40:55.311388 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:40:55.346475 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:40:55.399358 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:40:55.429118 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:40:55.464470 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:40:56.028866 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:40:56.034540 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:56.046406 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:40:56.112904 tst switch_tch_pdch.py: using LAC 18184 01:40:56.235682 tst switch_tch_pdch.py: using RAC 79 01:40:56.357650 tst switch_tch_pdch.py: using CellId 18184 01:40:56.480127 tst switch_tch_pdch.py: using BVCI 18185 01:40:56.594891 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:56.606641 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:56.618268 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:56.629926 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:56.641586 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:56.653103 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:56.664691 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:56.676306 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:40:56.792082 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:40:56.912242 tst switch_tch_pdch.py:51: start network... 01:40:57.126842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:57.617988 run create_hlr_db(pid=8066): Launched 01:40:57.749081 bus /gobi_6: Setting Powered False 01:40:58.812598 run create_hlr_db(pid=8066): Terminated: ok {rc=0} 01:40:59.256567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8068): Launched 01:40:59.573761 run osmo-hlr_10.42.42.2(pid=8069): Launched 01:40:59.695874 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:00.242253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8071): Launched 01:41:00.562098 run osmo-stp_10.42.42.5(pid=8072): Launched 01:41:00.683060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:41:01.227737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8074): Launched 01:41:01.359040 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:41:01.622273 run patchelf(pid=8075): Launched 01:41:01.798461 run osmo-stp_10.42.42.5(pid=8072): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8072)] 01:41:01.930594 run osmo-stp_10.42.42.5(pid=8072): stdout: | (launched: 2022-12-09_01:41:00.503467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:02.062701 run osmo-stp_10.42.42.5(pid=8072): stderr: | 20221209014100696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014100696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014100697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014100697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014100697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014100698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014100698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:02.196254 run osmo-stp_10.42.42.5(pid=8072): stdout: | (launched: 2022-12-09_01:41:00.503467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:02.320150 run osmo-stp_10.42.42.5(pid=8072): stderr: | 20221209014100696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014100696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014100697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014100697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014100697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014100698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014100698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:02.465977 run patchelf(pid=8075): Terminating (SIGINT) 01:41:02.634100 run patchelf(pid=8075): Terminated: ok {rc=0} 01:41:02.755162 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8072): Process ended prematurely: osmo-stp_10.42.42.5(pid=8072) [trial-2352↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8072)] [trial-2352↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:41:02.764310 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 01:41:02.791703 run osmo-hlr_10.42.42.2(pid=8069): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8069)] 01:41:02.840222 run osmo-hlr_10.42.42.2(pid=8069): stdout: | (launched: 2022-12-09_01:40:59.515864) 01:41:02.890231 run osmo-hlr_10.42.42.2(pid=8069): stderr: | 20221209014059714 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014059714 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014059714 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014059714 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014059714 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014059714 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014059727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014059737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014059737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014059737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:02.940514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8068): Terminating (SIGTERM) 01:41:02.981031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8071): Terminating (SIGTERM) 01:41:03.021251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8074): Terminating (SIGTERM) 01:41:03.061805 --- ParallelTerminationStrategy: PID 8068 died... 01:41:03.081111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8068): Terminated: ok {rc=0} 01:41:03.125849 --- ParallelTerminationStrategy: PID 8071 died... 01:41:03.144630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8071): Terminated: ok {rc=0} 01:41:03.189761 --- ParallelTerminationStrategy: PID 8074 died... 01:41:03.208579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8074): Terminated: ok {rc=0} 01:41:03.295254 bus /gobi_0: Setting Powered False 01:41:04.395599 bus /gobi_0: Setting Powered False 01:41:05.514483 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:41:06.768717 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:06.775782 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:41:06.805946 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:41:06.841512 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:41:06.895784 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:41:06.925556 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:41:06.960898 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:41:07.522370 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:41:07.528719 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:41:07.540867 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:41:07.605626 tst switch_tch_pdch.py: using LAC 18185 01:41:07.720426 tst switch_tch_pdch.py: using RAC 80 01:41:07.839209 tst switch_tch_pdch.py: using CellId 18185 01:41:07.954295 tst switch_tch_pdch.py: using BVCI 18186 01:41:08.063663 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:41:08.074820 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:41:08.085729 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:41:08.096821 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:41:08.107931 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:41:08.118952 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:41:08.130096 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:41:08.141127 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:41:08.260365 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:41:08.376943 tst switch_tch_pdch.py:51: start network... 01:41:08.575748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:09.008070 run create_hlr_db(pid=8079): Launched 01:41:09.121302 bus /gobi_6: Setting Powered False 01:41:10.181139 run create_hlr_db(pid=8079): Terminated: ok {rc=0} 01:41:10.589495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8081): Launched 01:41:10.908252 run osmo-hlr_10.42.42.2(pid=8082): Launched 01:41:11.030062 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:11.550799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8084): Launched 01:41:11.868819 run osmo-stp_10.42.42.5(pid=8085): Launched 01:41:11.990175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:41:12.511605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8087): Launched 01:41:12.633171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:41:12.901235 run patchelf(pid=8088): Launched 01:41:13.080327 run osmo-stp_10.42.42.5(pid=8085): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8085)] 01:41:13.215671 run osmo-stp_10.42.42.5(pid=8085): stdout: | (launched: 2022-12-09_01:41:11.811080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:13.352898 run osmo-stp_10.42.42.5(pid=8085): stderr: | 20221209014112002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014112002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014112002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014112003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014112003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014112003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014112003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:13.489537 run osmo-stp_10.42.42.5(pid=8085): stdout: | (launched: 2022-12-09_01:41:11.811080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:13.619771 run osmo-stp_10.42.42.5(pid=8085): stderr: | 20221209014112002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014112002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014112002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014112003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014112003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014112003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014112003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:13.774663 run patchelf(pid=8088): Terminating (SIGINT) 01:41:13.953524 run patchelf(pid=8088): Terminated: ok {rc=0} 01:41:14.082426 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8085): Process ended prematurely: osmo-stp_10.42.42.5(pid=8085) [trial-2352↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8085)] [trial-2352↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:41:14.092319 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 01:41:14.120914 run osmo-hlr_10.42.42.2(pid=8082): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8082)] 01:41:14.171704 run osmo-hlr_10.42.42.2(pid=8082): stdout: | (launched: 2022-12-09_01:41:10.850306) 01:41:14.224128 run osmo-hlr_10.42.42.2(pid=8082): stderr: | 20221209014111048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014111048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014111048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014111048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014111048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014111048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014111058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014111067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014111067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014111067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:14.276894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8081): Terminating (SIGTERM) 01:41:14.318891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8084): Terminating (SIGTERM) 01:41:14.361387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8087): Terminating (SIGTERM) 01:41:14.403828 --- ParallelTerminationStrategy: PID 8081 died... 01:41:14.423754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8081): Terminated: ok {rc=0} 01:41:14.470569 --- ParallelTerminationStrategy: PID 8084 died... 01:41:14.490373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8084): Terminated: ok {rc=0} 01:41:14.537039 --- ParallelTerminationStrategy: PID 8087 died... 01:41:14.556791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8087): Terminated: ok {rc=0} 01:41:14.645130 bus /gobi_0: Setting Powered False 01:41:15.744793 bus /gobi_0: Setting Powered False 01:41:16.863990 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_sms:nanobts --------------------------------------------------------------------- 01:41:18.116432 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:18.120075 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 01:41:18.145751 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 01:41:18.153352 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 01:41:18.204801 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 01:41:18.229523 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 01:41:18.236813 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 01:41:18.774665 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 01:41:18.780010 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 01:41:18.791245 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 01:41:18.830064 tst mo_mt_sms.py: using LAC 18186 01:41:18.952094 tst mo_mt_sms.py: using RAC 81 01:41:19.070216 tst mo_mt_sms.py: using CellId 18186 01:41:19.186168 tst mo_mt_sms.py: using BVCI 18187 01:41:19.296332 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 01:41:19.411041 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 01:41:19.529862 tst mo_mt_sms.py:9: start nitb and bts... 01:41:19.728356 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:41:20.334475 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8093): Launched 01:41:20.630964 run osmo-nitb_10.42.42.2(pid=8094): Launched 01:41:20.797588 run osmo-nitb_10.42.42.2(pid=8094): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8094)] 01:41:20.931268 run osmo-nitb_10.42.42.2(pid=8094): stdout: | (launched: 2022-12-09_01:41:20.576308) 01:41:21.066538 run osmo-nitb_10.42.42.2(pid=8094): stderr: | (launched: 2022-12-09_01:41:20.620408) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:41:21.202189 run osmo-nitb_10.42.42.2(pid=8094): stdout: | (launched: 2022-12-09_01:41:20.576308) 01:41:21.332047 run osmo-nitb_10.42.42.2(pid=8094): stderr: | (launched: 2022-12-09_01:41:20.620408) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8094) [trial-2352↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8094)] 01:41:21.745469 tst osmo-nitb_10.42.42.2(pid=8094): stdout: | (launched: 2022-12-09_01:41:20.576308) 01:41:21.867026 tst osmo-nitb_10.42.42.2(pid=8094): stderr: | (launched: 2022-12-09_01:41:20.620408) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:41:22.013652 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8094) [trial-2352↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8094)] [trial-2352↪nitb_sms:nanobts↪mo_mt_sms.py:11] 01:41:22.022214 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 01:41:22.029051 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8093): Terminating (SIGTERM) 01:41:22.238454 --- ParallelTerminationStrategy: PID 8093 died... 01:41:22.259442 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8093): Terminated: ok {rc=0} 01:41:22.343889 bus /sierra_3: Setting Powered False 01:41:23.440364 bus /sierra_3: Setting Powered False 01:41:24.554251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 sms:nanobts+band-1900 --------------------------------------------------------------------- 01:41:25.742099 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:25.747674 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:41:25.772071 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 01:41:25.799638 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 01:41:25.855399 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:41:25.880035 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 01:41:25.907290 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 01:41:26.452824 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 01:41:26.457944 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:26.469143 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:41:26.507668 tst mo_mt_sms.py: using LAC 18187 01:41:26.633229 tst mo_mt_sms.py: using RAC 82 01:41:26.758505 tst mo_mt_sms.py: using CellId 18187 01:41:26.885281 tst mo_mt_sms.py: using BVCI 18188 01:41:27.001643 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:27.012896 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:27.024027 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:27.035003 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:27.046116 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:27.057044 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 01:41:27.170712 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 01:41:27.288459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:27.779387 run create_hlr_db(pid=8098): Launched 01:41:27.909285 bus /sierra_2: Setting Powered False 01:41:28.972642 run create_hlr_db(pid=8098): Terminated: ok {rc=0} 01:41:29.399176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8100): Launched 01:41:29.697386 run osmo-hlr_10.42.42.2(pid=8101): Launched 01:41:29.811430 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:30.339870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8103): Launched 01:41:30.637428 run osmo-stp_10.42.42.5(pid=8104): Launched 01:41:30.752256 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:31.323980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8106): Launched 01:41:31.641521 run osmo-msc_10.42.42.6(pid=8107): Launched 01:41:31.976212 run osmo-stp_10.42.42.5(pid=8104): ERR: Terminated: ERROR {rc=1} [trial-2352↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8104)] 01:41:32.221776 run osmo-stp_10.42.42.5(pid=8104): stdout: | (launched: 2022-12-09_01:41:30.582866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:32.357944 run osmo-stp_10.42.42.5(pid=8104): stderr: | 20221209014130752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014130752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014130752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014130753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014130753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014130753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014130753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:32.492623 run osmo-stp_10.42.42.5(pid=8104): stdout: | (launched: 2022-12-09_01:41:30.582866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:32.619640 run osmo-stp_10.42.42.5(pid=8104): stderr: | 20221209014130752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014130752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014130752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014130753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014130753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014130753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014130753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:32.771319 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8104): Process ended prematurely: osmo-stp_10.42.42.5(pid=8104) [trial-2352↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8104)] [trial-2352↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 01:41:32.780214 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 01:41:32.807822 run osmo-hlr_10.42.42.2(pid=8101): ERR: Terminated: ERROR {rc=237} [trial-2352↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8101)] 01:41:32.858408 run osmo-hlr_10.42.42.2(pid=8101): stdout: | (launched: 2022-12-09_01:41:29.642142) 01:41:32.910740 run osmo-hlr_10.42.42.2(pid=8101): stderr: | 20221209014129818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014129818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014129818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014129818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014129818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014129818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014129830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014129841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014129842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014129842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:32.984238 run osmo-msc_10.42.42.6(pid=8107): ERR: Terminated: ERROR {rc=2} [trial-2352↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8107)] 01:41:33.034734 run osmo-msc_10.42.42.6(pid=8107): stdout: | (launched: 2022-12-09_01:41:31.582675) 01:41:33.087035 run osmo-msc_10.42.42.6(pid=8107): stderr: | 20221209014132176 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014132177 DLGLOBAL DEBUG validating counter group 0x7fdfeef2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014132177 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014132177 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014132177 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014132177 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014132179 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014132179 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014132179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014132179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:33.139920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8100): Terminating (SIGTERM) 01:41:33.182983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8103): Terminating (SIGTERM) 01:41:33.225802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8106): Terminating (SIGTERM) 01:41:33.268427 --- ParallelTerminationStrategy: PID 8100 died... 01:41:33.288793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8100): Terminated: ok {rc=0} 01:41:33.335871 --- ParallelTerminationStrategy: PID 8103 died... 01:41:33.355779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8103): Terminated: ok {rc=0} 01:41:33.402505 --- ParallelTerminationStrategy: PID 8106 died... 01:41:33.422537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8106): Terminated: ok {rc=0} 01:41:33.511714 bus /sierra_3: Setting Powered False 01:41:34.610624 bus /sierra_3: Setting Powered False 01:41:35.730465 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 01:41:36.953516 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:36.959181 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:41:36.983393 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 01:41:36.990839 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 01:41:37.026724 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:41:37.050978 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 01:41:37.057887 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 01:41:37.577738 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2352 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 01:41:37.584191 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 01:41:37.596068 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:41:37.633415 tst assert_extension.py: using LAC 18188 01:41:37.749641 tst assert_extension.py: using RAC 83 01:41:37.875140 tst assert_extension.py: using CellId 18188 01:41:37.999783 tst assert_extension.py: using BVCI 18189 01:41:38.115970 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 01:41:38.234199 tst assert_extension.py:10: start nitb and bts... 01:41:38.432685 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:41:39.039246 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8113): Launched 01:41:39.336650 run osmo-nitb_10.42.42.2(pid=8114): Launched 01:41:39.502174 run osmo-nitb_10.42.42.2(pid=8114): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8114)] 01:41:39.635575 run osmo-nitb_10.42.42.2(pid=8114): stdout: | (launched: 2022-12-09_01:41:39.281604) 01:41:39.770721 run osmo-nitb_10.42.42.2(pid=8114): stderr: | (launched: 2022-12-09_01:41:39.325746) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:41:39.905931 run osmo-nitb_10.42.42.2(pid=8114): stdout: | (launched: 2022-12-09_01:41:39.281604) 01:41:40.036353 run osmo-nitb_10.42.42.2(pid=8114): stderr: | (launched: 2022-12-09_01:41:39.325746) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8114): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8114) [trial-2352↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8114)] 01:41:40.449623 tst osmo-nitb_10.42.42.2(pid=8114): stdout: | (launched: 2022-12-09_01:41:39.281604) 01:41:40.571222 tst osmo-nitb_10.42.42.2(pid=8114): stderr: | (launched: 2022-12-09_01:41:39.325746) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:41:40.713232 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8114): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8114) [trial-2352↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8114)] [trial-2352↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 01:41:40.721613 tst assert_extension.py:12: Test FAILED (3.1 sec) 01:41:40.728044 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8113): Terminating (SIGTERM) 01:41:40.938232 --- ParallelTerminationStrategy: PID 8113 died... 01:41:40.959325 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8113): Terminated: ok {rc=0} 01:41:41.043197 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 ussd:nanobts+band-1900 --------------------------------------------------------------------- 01:41:42.208255 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:42.213444 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:41:42.237757 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 01:41:42.265035 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 01:41:42.300858 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:41:42.326205 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 01:41:42.354132 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 01:41:42.882856 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2352 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 01:41:42.888290 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:42.899537 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:41:42.938844 tst assert_extension.py: using LAC 18189 01:41:43.066596 tst assert_extension.py: using RAC 84 01:41:43.198728 tst assert_extension.py: using CellId 18189 01:41:43.323426 tst assert_extension.py: using BVCI 18190 01:41:43.439794 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:43.450934 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:43.461997 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:43.473067 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:43.484109 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:43.495099 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 01:41:43.609638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:44.070252 run create_hlr_db(pid=8118): Launched 01:41:44.184668 bus /sierra_2: Setting Powered False 01:41:45.245239 run create_hlr_db(pid=8118): Terminated: ok {rc=0} 01:41:45.682092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8120): Launched 01:41:46.014592 run osmo-hlr_10.42.42.2(pid=8121): Launched 01:41:46.265897 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:46.994235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8123): Launched 01:41:47.325624 run osmo-stp_10.42.42.5(pid=8124): Launched 01:41:47.448005 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:48.029742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8126): Launched 01:41:48.348939 run osmo-msc_10.42.42.6(pid=8127): Launched 01:41:48.526577 run osmo-stp_10.42.42.5(pid=8124): ERR: Terminated: ERROR {rc=1} [trial-2352↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8124)] 01:41:48.660754 run osmo-stp_10.42.42.5(pid=8124): stdout: | (launched: 2022-12-09_01:41:47.266701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:48.795323 run osmo-stp_10.42.42.5(pid=8124): stderr: | 20221209014147459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014147459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014147459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014147460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014147460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014147460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014147460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:48.929171 run osmo-stp_10.42.42.5(pid=8124): stdout: | (launched: 2022-12-09_01:41:47.266701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:49.056303 run osmo-stp_10.42.42.5(pid=8124): stderr: | 20221209014147459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014147459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014147459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014147460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014147460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014147460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014147460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:49.207682 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8124): Process ended prematurely: osmo-stp_10.42.42.5(pid=8124) [trial-2352↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8124)] [trial-2352↪ussd:nanobts+band-1900↪assert_extension.py:17] 01:41:49.216625 tst assert_extension.py:17: Test FAILED (6.3 sec) 01:41:49.244113 run osmo-hlr_10.42.42.2(pid=8121): ERR: Terminated: ERROR {rc=237} [trial-2352↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8121)] 01:41:49.294503 run osmo-hlr_10.42.42.2(pid=8121): stdout: | (launched: 2022-12-09_01:41:45.958815) 01:41:49.346564 run osmo-hlr_10.42.42.2(pid=8121): stderr: | 20221209014146376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014146376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014146376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014146376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014146376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014146376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014146403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014146421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014146421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014146421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:49.419328 run osmo-msc_10.42.42.6(pid=8127): ERR: Terminated: ERROR {rc=2} [trial-2352↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8127)] 01:41:49.469411 run osmo-msc_10.42.42.6(pid=8127): stdout: | (launched: 2022-12-09_01:41:48.290486) 01:41:49.521380 run osmo-msc_10.42.42.6(pid=8127): stderr: | 20221209014148612 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014148612 DLGLOBAL DEBUG validating counter group 0x7f3aaa0b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014148612 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014148612 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014148612 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014148613 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014148614 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014148615 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014148615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014148615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:49.574225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8120): Terminating (SIGTERM) 01:41:49.616165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8123): Terminating (SIGTERM) 01:41:49.658143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8126): Terminating (SIGTERM) 01:41:49.700132 --- ParallelTerminationStrategy: PID 8120 died... 01:41:49.720074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8120): Terminated: ok {rc=0} 01:41:49.766921 --- ParallelTerminationStrategy: PID 8123 died... 01:41:49.786598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8123): Terminated: ok {rc=0} 01:41:49.832650 --- ParallelTerminationStrategy: PID 8126 died... 01:41:49.852398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8126): Terminated: ok {rc=0} 01:41:49.940938 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:41:51.143386 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:51.151857 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:41:51.177135 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:41:51.204307 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:41:51.257193 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:41:51.281434 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:41:51.308439 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:41:51.861899 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:41:51.914179 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:51.926336 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:41:51.991510 tst mo_mt_call.py: using LAC 18190 01:41:52.118645 tst mo_mt_call.py: using RAC 85 01:41:52.242748 tst mo_mt_call.py: using CellId 18190 01:41:52.367560 tst mo_mt_call.py: using BVCI 18191 01:41:52.486001 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:52.497730 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:52.509175 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:52.520650 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:52.532335 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:52.543797 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:41:52.659399 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:41:52.776504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:53.245383 run create_hlr_db(pid=8132): Launched 01:41:53.362500 bus /sierra_2: Setting Powered False 01:41:54.422538 run create_hlr_db(pid=8132): Terminated: ok {rc=0} 01:41:54.863626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8134): Launched 01:41:55.186954 run osmo-hlr_10.42.42.2(pid=8135): Launched 01:41:55.310990 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:55.866513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8137): Launched 01:41:56.189489 run osmo-stp_10.42.42.5(pid=8138): Launched 01:41:56.312530 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:56.900318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8140): Launched 01:41:57.224138 run osmo-msc_10.42.42.6(pid=8141): Launched 01:41:57.403739 run osmo-stp_10.42.42.5(pid=8138): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8138)] 01:41:57.539685 run osmo-stp_10.42.42.5(pid=8138): stdout: | (launched: 2022-12-09_01:41:56.130708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:57.676909 run osmo-stp_10.42.42.5(pid=8138): stderr: | 20221209014156321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014156322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014156322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014156322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014156323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014156323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014156323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:57.812247 run osmo-stp_10.42.42.5(pid=8138): stdout: | (launched: 2022-12-09_01:41:56.130708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:57.940693 run osmo-stp_10.42.42.5(pid=8138): stderr: | 20221209014156321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014156322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014156322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014156322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014156323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014156323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014156323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:58.095229 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8138): Process ended prematurely: osmo-stp_10.42.42.5(pid=8138) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8138)] [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:41:58.104780 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:41:58.132628 run osmo-hlr_10.42.42.2(pid=8135): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8135)] 01:41:58.182788 run osmo-hlr_10.42.42.2(pid=8135): stdout: | (launched: 2022-12-09_01:41:55.128220) 01:41:58.234734 run osmo-hlr_10.42.42.2(pid=8135): stderr: | 20221209014155325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014155325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014155325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014155325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014155325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014155325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014155338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014155346 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014155346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014155346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:58.307710 run osmo-msc_10.42.42.6(pid=8141): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8141)] 01:41:58.357866 run osmo-msc_10.42.42.6(pid=8141): stdout: | (launched: 2022-12-09_01:41:57.164742) 01:41:58.409578 run osmo-msc_10.42.42.6(pid=8141): stderr: | 20221209014157487 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014157487 DLGLOBAL DEBUG validating counter group 0x7f7bdcbb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014157487 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014157487 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014157487 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014157488 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014157489 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014157490 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014157490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014157490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:58.461620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8134): Terminating (SIGTERM) 01:41:58.503070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8137): Terminating (SIGTERM) 01:41:58.544732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8140): Terminating (SIGTERM) 01:41:58.586531 --- ParallelTerminationStrategy: PID 8134 died... 01:41:58.606216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8134): Terminated: ok {rc=0} 01:41:58.652318 --- ParallelTerminationStrategy: PID 8137 died... 01:41:58.671998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8137): Terminated: ok {rc=0} 01:41:58.717820 --- ParallelTerminationStrategy: PID 8140 died... 01:41:58.737421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8140): Terminated: ok {rc=0} 01:41:58.826155 bus /sierra_3: Setting Powered False 01:41:59.925715 bus /sierra_3: Setting Powered False 01:42:01.092301 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:42:02.255121 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:42:02.268072 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:42:02.330420 tst mo_mt_call_osmux.py: using LAC 18191 01:42:02.449295 tst mo_mt_call_osmux.py: using RAC 86 01:42:02.569409 tst mo_mt_call_osmux.py: using CellId 18191 01:42:02.689329 tst mo_mt_call_osmux.py: using BVCI 18192 01:42:02.800792 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:42:02.812311 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:42:02.823248 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:42:02.834357 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:42:02.845996 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:42:02.857248 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:42:02.975318 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:42:03.091953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:03.559498 run create_hlr_db(pid=8148): Launched 01:42:03.675149 bus /sierra_2: Setting Powered False 01:42:04.736362 run create_hlr_db(pid=8148): Terminated: ok {rc=0} 01:42:05.178996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8150): Launched 01:42:05.504931 run osmo-hlr_10.42.42.2(pid=8151): Launched 01:42:05.631080 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:06.193645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8153): Launched 01:42:06.518893 run osmo-stp_10.42.42.5(pid=8154): Launched 01:42:06.643234 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:07.229733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8156): Launched 01:42:07.554071 run osmo-msc_10.42.42.6(pid=8157): Launched 01:42:07.737595 run osmo-stp_10.42.42.5(pid=8154): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8154)] 01:42:07.873345 run osmo-stp_10.42.42.5(pid=8154): stdout: | (launched: 2022-12-09_01:42:06.459921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:08.010202 run osmo-stp_10.42.42.5(pid=8154): stderr: | 20221209014206652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014206652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014206652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014206653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014206653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014206653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014206653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:08.145602 run osmo-stp_10.42.42.5(pid=8154): stdout: | (launched: 2022-12-09_01:42:06.459921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:08.274148 run osmo-stp_10.42.42.5(pid=8154): stderr: | 20221209014206652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014206652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014206652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014206653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014206653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014206653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014206653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:08.428301 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8154): Process ended prematurely: osmo-stp_10.42.42.5(pid=8154) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8154)] [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:42:08.437877 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:42:08.465692 run osmo-hlr_10.42.42.2(pid=8151): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8151)] 01:42:08.515660 run osmo-hlr_10.42.42.2(pid=8151): stdout: | (launched: 2022-12-09_01:42:05.446145) 01:42:08.567383 run osmo-hlr_10.42.42.2(pid=8151): stderr: | 20221209014205645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014205645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014205645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014205645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014205645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014205646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014205658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014205666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014205666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014205667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:08.639796 run osmo-msc_10.42.42.6(pid=8157): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8157)] 01:42:08.689918 run osmo-msc_10.42.42.6(pid=8157): stdout: | (launched: 2022-12-09_01:42:07.495019) 01:42:08.741696 run osmo-msc_10.42.42.6(pid=8157): stderr: | 20221209014207818 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014207818 DLGLOBAL DEBUG validating counter group 0x7fd8a9a59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014207818 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014207818 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014207818 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014207819 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014207820 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014207821 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014207821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014207821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:08.793850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8150): Terminating (SIGTERM) 01:42:08.835535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8153): Terminating (SIGTERM) 01:42:08.877140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8156): Terminating (SIGTERM) 01:42:08.919286 --- ParallelTerminationStrategy: PID 8150 died... 01:42:08.939244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8150): Terminated: ok {rc=0} 01:42:08.985854 --- ParallelTerminationStrategy: PID 8153 died... 01:42:09.005493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8153): Terminated: ok {rc=0} 01:42:09.051539 --- ParallelTerminationStrategy: PID 8156 died... 01:42:09.071215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8156): Terminated: ok {rc=0} 01:42:09.158368 bus /sierra_3: Setting Powered False 01:42:10.258616 bus /sierra_3: Setting Powered False 01:42:11.373935 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:42:12.616138 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:42:12.623495 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:42:12.647167 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:42:12.674406 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:42:12.726823 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:42:12.751263 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:42:12.777475 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:42:13.326917 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:42:13.375876 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:13.386997 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:42:13.445427 tst mo_mt_call.py: using LAC 18192 01:42:13.571925 tst mo_mt_call.py: using RAC 87 01:42:13.698490 tst mo_mt_call.py: using CellId 18192 01:42:13.830269 tst mo_mt_call.py: using BVCI 18193 01:42:13.948418 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:13.960121 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:13.971586 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:13.983497 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:13.995553 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:14.007063 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:42:14.123756 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:42:14.243075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:14.740850 run create_hlr_db(pid=8162): Launched 01:42:14.873616 bus /sierra_2: Setting Powered False 01:42:15.950405 run create_hlr_db(pid=8162): Terminated: ok {rc=0} 01:42:16.453793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8164): Launched 01:42:16.796844 run osmo-hlr_10.42.42.2(pid=8165): Launched 01:42:17.040841 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:17.650352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8167): Launched 01:42:17.955137 run osmo-stp_10.42.42.5(pid=8168): Launched 01:42:18.071177 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:18.617908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8170): Launched 01:42:18.922827 run osmo-msc_10.42.42.6(pid=8171): Launched 01:42:19.092159 run osmo-stp_10.42.42.5(pid=8168): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8168)] 01:42:19.220710 run osmo-stp_10.42.42.5(pid=8168): stdout: | (launched: 2022-12-09_01:42:17.899876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:19.349403 run osmo-stp_10.42.42.5(pid=8168): stderr: | 20221209014218068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014218068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014218068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014218069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014218069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014218069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014218069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:19.475635 run osmo-stp_10.42.42.5(pid=8168): stdout: | (launched: 2022-12-09_01:42:17.899876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:19.595721 run osmo-stp_10.42.42.5(pid=8168): stderr: | 20221209014218068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014218068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014218068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014218069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014218069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014218069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014218069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:19.739455 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8168): Process ended prematurely: osmo-stp_10.42.42.5(pid=8168) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8168)] [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:42:19.748334 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:42:19.774878 run osmo-hlr_10.42.42.2(pid=8165): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8165)] 01:42:19.822993 run osmo-hlr_10.42.42.2(pid=8165): stdout: | (launched: 2022-12-09_01:42:16.737610) 01:42:19.872395 run osmo-hlr_10.42.42.2(pid=8165): stderr: | 20221209014217032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014217032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014217032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014217032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014217032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014217032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014217058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014217066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014217066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014217066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:19.941623 run osmo-msc_10.42.42.6(pid=8171): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8171)] 01:42:19.989447 run osmo-msc_10.42.42.6(pid=8171): stdout: | (launched: 2022-12-09_01:42:18.867300) 01:42:20.038667 run osmo-msc_10.42.42.6(pid=8171): stderr: | 20221209014219139 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014219139 DLGLOBAL DEBUG validating counter group 0x7feebf329c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014219139 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014219139 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014219140 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014219140 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014219141 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014219142 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014219142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014219142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:20.088306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8164): Terminating (SIGTERM) 01:42:20.127931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8167): Terminating (SIGTERM) 01:42:20.167491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8170): Terminating (SIGTERM) 01:42:20.207666 --- ParallelTerminationStrategy: PID 8164 died... 01:42:20.226663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8164): Terminated: ok {rc=0} 01:42:20.270681 --- ParallelTerminationStrategy: PID 8167 died... 01:42:20.289140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8167): Terminated: ok {rc=0} 01:42:20.333254 --- ParallelTerminationStrategy: PID 8170 died... 01:42:20.351721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8170): Terminated: ok {rc=0} 01:42:20.435555 bus /sierra_3: Setting Powered False 01:42:21.534127 bus /sierra_3: Setting Powered False 01:42:22.650526 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:42:23.799620 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:23.811889 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:42:23.873504 tst mo_mt_call_osmux.py: using LAC 18193 01:42:24.001811 tst mo_mt_call_osmux.py: using RAC 88 01:42:24.121596 tst mo_mt_call_osmux.py: using CellId 18193 01:42:24.241406 tst mo_mt_call_osmux.py: using BVCI 18194 01:42:24.351179 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:24.362764 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:24.374123 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:24.385976 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:24.397963 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:24.409974 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:42:24.530060 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:42:24.646723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:25.115461 run create_hlr_db(pid=8173): Launched 01:42:25.230840 bus /sierra_2: Setting Powered False 01:42:26.290598 run create_hlr_db(pid=8173): Terminated: ok {rc=0} 01:42:26.733065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8175): Launched 01:42:27.057652 run osmo-hlr_10.42.42.2(pid=8176): Launched 01:42:27.183964 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:27.745106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8178): Launched 01:42:28.069125 run osmo-stp_10.42.42.5(pid=8179): Launched 01:42:28.193805 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:28.779452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8181): Launched 01:42:29.107046 run osmo-msc_10.42.42.6(pid=8182): Launched 01:42:29.287965 run osmo-stp_10.42.42.5(pid=8179): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8179)] 01:42:29.424778 run osmo-stp_10.42.42.5(pid=8179): stdout: | (launched: 2022-12-09_01:42:28.010318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:29.561610 run osmo-stp_10.42.42.5(pid=8179): stderr: | 20221209014228201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014228201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014228201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014228202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014228202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014228202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014228202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:29.698492 run osmo-stp_10.42.42.5(pid=8179): stdout: | (launched: 2022-12-09_01:42:28.010318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:29.828279 run osmo-stp_10.42.42.5(pid=8179): stderr: | 20221209014228201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014228201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014228201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014228202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014228202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014228202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014228202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:29.983160 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8179): Process ended prematurely: osmo-stp_10.42.42.5(pid=8179) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8179)] [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:42:29.992874 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:42:30.020828 run osmo-hlr_10.42.42.2(pid=8176): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8176)] 01:42:30.071285 run osmo-hlr_10.42.42.2(pid=8176): stdout: | (launched: 2022-12-09_01:42:26.998659) 01:42:30.123533 run osmo-hlr_10.42.42.2(pid=8176): stderr: | 20221209014227197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014227197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014227197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014227197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014227197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014227197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014227210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014227218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014227218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014227218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:30.196017 run osmo-msc_10.42.42.6(pid=8182): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8182)] 01:42:30.246683 run osmo-msc_10.42.42.6(pid=8182): stdout: | (launched: 2022-12-09_01:42:29.047499) 01:42:30.298467 run osmo-msc_10.42.42.6(pid=8182): stderr: | 20221209014229370 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014229370 DLGLOBAL DEBUG validating counter group 0x7f1c57cddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014229370 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014229370 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014229370 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014229370 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014229372 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014229373 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014229373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014229373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:30.350994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8175): Terminating (SIGTERM) 01:42:30.392849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8178): Terminating (SIGTERM) 01:42:30.435021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8181): Terminating (SIGTERM) 01:42:30.477235 --- ParallelTerminationStrategy: PID 8175 died... 01:42:30.497046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8175): Terminated: ok {rc=0} 01:42:30.543420 --- ParallelTerminationStrategy: PID 8178 died... 01:42:30.563272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8178): Terminated: ok {rc=0} 01:42:30.609581 --- ParallelTerminationStrategy: PID 8181 died... 01:42:30.629234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8181): Terminated: ok {rc=0} 01:42:30.717603 bus /sierra_3: Setting Powered False 01:42:31.823716 bus /sierra_3: Setting Powered False 01:42:32.953847 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:42:34.192852 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:42:34.199959 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:42:34.223263 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:42:34.250417 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:42:34.303260 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:42:34.326879 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:42:34.353921 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:42:34.903216 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:42:34.952284 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:34.963413 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:42:35.023379 tst mo_mt_call.py: using LAC 18194 01:42:35.147007 tst mo_mt_call.py: using RAC 89 01:42:35.265978 tst mo_mt_call.py: using CellId 18194 01:42:35.386184 tst mo_mt_call.py: using BVCI 18195 01:42:35.498577 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:35.509720 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:35.520589 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:35.531572 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:35.543214 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:35.555074 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:42:35.671989 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:42:35.794638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:36.296323 run create_hlr_db(pid=8187): Launched 01:42:36.428579 bus /sierra_2: Setting Powered False 01:42:37.493174 run create_hlr_db(pid=8187): Terminated: ok {rc=0} 01:42:37.924434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8189): Launched 01:42:38.227940 run osmo-hlr_10.42.42.2(pid=8190): Launched 01:42:38.343129 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:38.868434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8192): Launched 01:42:39.170861 run osmo-stp_10.42.42.5(pid=8193): Launched 01:42:39.286053 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:39.833200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8195): Launched 01:42:40.138917 run osmo-msc_10.42.42.6(pid=8196): Launched 01:42:40.309786 run osmo-stp_10.42.42.5(pid=8193): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8193)] 01:42:40.439094 run osmo-stp_10.42.42.5(pid=8193): stdout: | (launched: 2022-12-09_01:42:39.115277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:40.567423 run osmo-stp_10.42.42.5(pid=8193): stderr: | 20221209014239285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014239285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014239285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014239286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014239286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014239286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014239286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:40.693647 run osmo-stp_10.42.42.5(pid=8193): stdout: | (launched: 2022-12-09_01:42:39.115277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:40.813936 run osmo-stp_10.42.42.5(pid=8193): stderr: | 20221209014239285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014239285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014239285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014239286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014239286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014239286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014239286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:40.958027 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8193): Process ended prematurely: osmo-stp_10.42.42.5(pid=8193) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8193)] [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:42:40.966808 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:42:40.993618 run osmo-hlr_10.42.42.2(pid=8190): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8190)] 01:42:41.041939 run osmo-hlr_10.42.42.2(pid=8190): stdout: | (launched: 2022-12-09_01:42:38.172572) 01:42:41.091672 run osmo-hlr_10.42.42.2(pid=8190): stderr: | 20221209014238348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014238348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014238348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014238348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014238348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014238348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014238360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014238369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014238370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014238370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:41.161329 run osmo-msc_10.42.42.6(pid=8196): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8196)] 01:42:41.209690 run osmo-msc_10.42.42.6(pid=8196): stdout: | (launched: 2022-12-09_01:42:40.082416) 01:42:41.259449 run osmo-msc_10.42.42.6(pid=8196): stderr: | 20221209014240354 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014240354 DLGLOBAL DEBUG validating counter group 0x7f092602bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014240354 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014240354 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014240354 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014240355 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014240356 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014240357 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014240357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014240357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:41.309787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8189): Terminating (SIGTERM) 01:42:41.349187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8192): Terminating (SIGTERM) 01:42:41.389055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8195): Terminating (SIGTERM) 01:42:41.428868 --- ParallelTerminationStrategy: PID 8189 died... 01:42:41.448061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8189): Terminated: ok {rc=0} 01:42:41.492460 --- ParallelTerminationStrategy: PID 8192 died... 01:42:41.511059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8192): Terminated: ok {rc=0} 01:42:41.555081 --- ParallelTerminationStrategy: PID 8195 died... 01:42:41.573752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8195): Terminated: ok {rc=0} 01:42:41.659188 bus /sierra_3: Setting Powered False 01:42:42.760292 bus /sierra_3: Setting Powered False 01:42:43.875596 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:42:45.024276 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:45.036779 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:42:45.104294 tst mo_mt_call_osmux.py: using LAC 18195 01:42:45.233202 tst mo_mt_call_osmux.py: using RAC 90 01:42:45.359069 tst mo_mt_call_osmux.py: using CellId 18195 01:42:45.486736 tst mo_mt_call_osmux.py: using BVCI 18196 01:42:45.604483 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:45.616217 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:45.627927 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:45.639441 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:45.651023 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:45.662532 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:42:45.780807 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:42:45.926463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:46.412300 run create_hlr_db(pid=8198): Launched 01:42:46.606846 bus /sierra_2: Setting Powered False 01:42:47.666412 run create_hlr_db(pid=8198): Terminated: ok {rc=0} 01:42:48.122550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8200): Launched 01:42:48.446900 run osmo-hlr_10.42.42.2(pid=8201): Launched 01:42:48.571236 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:49.130666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8203): Launched 01:42:49.456335 run osmo-stp_10.42.42.5(pid=8204): Launched 01:42:49.579411 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:50.170797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8206): Launched 01:42:50.496931 run osmo-msc_10.42.42.6(pid=8207): Launched 01:42:50.678843 run osmo-stp_10.42.42.5(pid=8204): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8204)] 01:42:50.814853 run osmo-stp_10.42.42.5(pid=8204): stdout: | (launched: 2022-12-09_01:42:49.396664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:50.951567 run osmo-stp_10.42.42.5(pid=8204): stderr: | 20221209014249590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014249590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014249590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014249590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014249591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014249591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014249591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:51.087938 run osmo-stp_10.42.42.5(pid=8204): stdout: | (launched: 2022-12-09_01:42:49.396664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:51.216675 run osmo-stp_10.42.42.5(pid=8204): stderr: | 20221209014249590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014249590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014249590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014249590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014249591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014249591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014249591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:51.371054 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8204): Process ended prematurely: osmo-stp_10.42.42.5(pid=8204) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8204)] [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:42:51.380826 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 01:42:51.408692 run osmo-hlr_10.42.42.2(pid=8201): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8201)] 01:42:51.459203 run osmo-hlr_10.42.42.2(pid=8201): stdout: | (launched: 2022-12-09_01:42:48.387847) 01:42:51.511257 run osmo-hlr_10.42.42.2(pid=8201): stderr: | 20221209014248584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014248584 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014248584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014248584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014248584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014248584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014248597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014248605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014248605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014248605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:51.583555 run osmo-msc_10.42.42.6(pid=8207): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8207)] 01:42:51.633653 run osmo-msc_10.42.42.6(pid=8207): stdout: | (launched: 2022-12-09_01:42:50.438111) 01:42:51.685331 run osmo-msc_10.42.42.6(pid=8207): stderr: | 20221209014250765 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014250765 DLGLOBAL DEBUG validating counter group 0x7f5feec7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014250765 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014250765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014250765 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014250765 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014250767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014250767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014250767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014250768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:51.737398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8200): Terminating (SIGTERM) 01:42:51.779123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8203): Terminating (SIGTERM) 01:42:51.820847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8206): Terminating (SIGTERM) 01:42:51.863192 --- ParallelTerminationStrategy: PID 8200 died... 01:42:51.883464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8200): Terminated: ok {rc=0} 01:42:51.930300 --- ParallelTerminationStrategy: PID 8203 died... 01:42:51.950076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8203): Terminated: ok {rc=0} 01:42:51.996493 --- ParallelTerminationStrategy: PID 8206 died... 01:42:52.016279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8206): Terminated: ok {rc=0} 01:42:52.105249 bus /sierra_3: Setting Powered False 01:42:53.205003 bus /sierra_3: Setting Powered False 01:42:54.320696 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:42:55.562310 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:42:55.570296 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:42:55.594485 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:42:55.621734 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:42:55.675166 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:42:55.699679 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:42:55.726631 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:42:56.279145 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:42:56.330660 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:56.342356 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:42:56.407193 tst mo_mt_call.py: using LAC 18196 01:42:56.535487 tst mo_mt_call.py: using RAC 91 01:42:56.660921 tst mo_mt_call.py: using CellId 18196 01:42:56.786112 tst mo_mt_call.py: using BVCI 18197 01:42:56.902848 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:56.914542 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:56.926110 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:56.938040 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:56.949606 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:56.961129 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:42:57.078329 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:42:57.197606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:57.699537 run create_hlr_db(pid=8212): Launched 01:42:57.830805 bus /sierra_2: Setting Powered False 01:42:58.894632 run create_hlr_db(pid=8212): Terminated: ok {rc=0} 01:42:59.325756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8214): Launched 01:42:59.627800 run osmo-hlr_10.42.42.2(pid=8215): Launched 01:42:59.743265 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:00.263573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8217): Launched 01:43:00.567153 run osmo-stp_10.42.42.5(pid=8218): Launched 01:43:00.683237 run osmo-msc_10.42.42.6: Starting osmo-msc 01:43:01.267779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8220): Launched 01:43:01.584000 run osmo-msc_10.42.42.6(pid=8221): Launched 01:43:01.754506 run osmo-stp_10.42.42.5(pid=8218): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8218)] 01:43:01.916939 run osmo-stp_10.42.42.5(pid=8218): stdout: | (launched: 2022-12-09_01:43:00.511558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:02.143426 run osmo-stp_10.42.42.5(pid=8218): stderr: | 20221209014300679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014300679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014300680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014300680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014300680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014300681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014300681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:02.402950 run osmo-stp_10.42.42.5(pid=8218): stdout: | (launched: 2022-12-09_01:43:00.511558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:02.532665 run osmo-stp_10.42.42.5(pid=8218): stderr: | 20221209014300679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014300679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014300680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014300680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014300680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014300681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014300681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:02.687444 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8218): Process ended prematurely: osmo-stp_10.42.42.5(pid=8218) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8218)] [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:43:02.696932 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:43:02.725586 run osmo-hlr_10.42.42.2(pid=8215): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8215)] 01:43:02.776261 run osmo-hlr_10.42.42.2(pid=8215): stdout: | (launched: 2022-12-09_01:42:59.572366) 01:43:02.828701 run osmo-hlr_10.42.42.2(pid=8215): stderr: | 20221209014259752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014259752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014259752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014259752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014259752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014259752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014259764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014259773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014259773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014259773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:02.901862 run osmo-msc_10.42.42.6(pid=8221): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8221)] 01:43:02.952595 run osmo-msc_10.42.42.6(pid=8221): stdout: | (launched: 2022-12-09_01:43:01.521374) 01:43:03.005256 run osmo-msc_10.42.42.6(pid=8221): stderr: | 20221209014302148 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014302148 DLGLOBAL DEBUG validating counter group 0x7f2b62fcbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014302148 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014302148 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014302148 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014302148 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014302150 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014302150 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014302151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014302151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:43:03.058099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8214): Terminating (SIGTERM) 01:43:03.100317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8217): Terminating (SIGTERM) 01:43:03.142561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8220): Terminating (SIGTERM) 01:43:03.184814 --- ParallelTerminationStrategy: PID 8214 died... 01:43:03.205249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8214): Terminated: ok {rc=0} 01:43:03.252385 --- ParallelTerminationStrategy: PID 8217 died... 01:43:03.272111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8217): Terminated: ok {rc=0} 01:43:03.318775 --- ParallelTerminationStrategy: PID 8220 died... 01:43:03.338925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8220): Terminated: ok {rc=0} 01:43:03.427534 bus /sierra_3: Setting Powered False 01:43:04.527376 bus /sierra_3: Setting Powered False 01:43:05.642787 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:43:06.792553 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:43:06.804796 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:43:06.865966 tst mo_mt_call_osmux.py: using LAC 18197 01:43:06.992537 tst mo_mt_call_osmux.py: using RAC 92 01:43:07.119971 tst mo_mt_call_osmux.py: using CellId 18197 01:43:07.246590 tst mo_mt_call_osmux.py: using BVCI 18198 01:43:07.363798 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:43:07.375586 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:43:07.387083 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:43:07.398724 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:43:07.410406 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:43:07.422011 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:43:07.537712 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:43:07.658130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:08.158843 run create_hlr_db(pid=8223): Launched 01:43:08.292524 bus /sierra_2: Setting Powered False 01:43:09.357336 run create_hlr_db(pid=8223): Terminated: ok {rc=0} 01:43:09.789121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8225): Launched 01:43:10.091988 run osmo-hlr_10.42.42.2(pid=8226): Launched 01:43:10.208420 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:10.742275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8228): Launched 01:43:11.045333 run osmo-stp_10.42.42.5(pid=8229): Launched 01:43:11.160789 run osmo-msc_10.42.42.6: Starting osmo-msc 01:43:11.709420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8231): Launched 01:43:12.014593 run osmo-msc_10.42.42.6(pid=8232): Launched 01:43:12.184734 run osmo-stp_10.42.42.5(pid=8229): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8229)] 01:43:12.313941 run osmo-stp_10.42.42.5(pid=8229): stdout: | (launched: 2022-12-09_01:43:10.989823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:12.442276 run osmo-stp_10.42.42.5(pid=8229): stderr: | 20221209014311160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014311160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014311161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014311161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014311161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014311161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014311162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:12.568628 run osmo-stp_10.42.42.5(pid=8229): stdout: | (launched: 2022-12-09_01:43:10.989823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:12.689107 run osmo-stp_10.42.42.5(pid=8229): stderr: | 20221209014311160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014311160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014311161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014311161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014311161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014311161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014311162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:12.833398 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8229): Process ended prematurely: osmo-stp_10.42.42.5(pid=8229) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8229)] [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:43:12.842236 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:43:12.869047 run osmo-hlr_10.42.42.2(pid=8226): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8226)] 01:43:12.917149 run osmo-hlr_10.42.42.2(pid=8226): stdout: | (launched: 2022-12-09_01:43:10.036608) 01:43:12.971637 run osmo-hlr_10.42.42.2(pid=8226): stderr: | 20221209014310212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014310212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014310212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014310212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014310212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014310212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014310224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014310233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014310233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014310233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:13.044503 run osmo-msc_10.42.42.6(pid=8232): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8232)] 01:43:13.094675 run osmo-msc_10.42.42.6(pid=8232): stdout: | (launched: 2022-12-09_01:43:11.958920) 01:43:13.146243 run osmo-msc_10.42.42.6(pid=8232): stderr: | 20221209014312227 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014312228 DLGLOBAL DEBUG validating counter group 0x7ff0d3c02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014312228 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014312228 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014312228 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014312228 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014312230 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014312230 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014312230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014312231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:43:13.198036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8225): Terminating (SIGTERM) 01:43:13.240322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8228): Terminating (SIGTERM) 01:43:13.282333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8231): Terminating (SIGTERM) 01:43:13.324488 --- ParallelTerminationStrategy: PID 8225 died... 01:43:13.344817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8225): Terminated: ok {rc=0} 01:43:13.391276 --- ParallelTerminationStrategy: PID 8228 died... 01:43:13.410970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8228): Terminated: ok {rc=0} 01:43:13.457162 --- ParallelTerminationStrategy: PID 8231 died... 01:43:13.476834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8231): Terminated: ok {rc=0} 01:43:13.563796 bus /sierra_3: Setting Powered False 01:43:14.662761 bus /sierra_3: Setting Powered False 01:43:15.778322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:43:17.039927 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:43:17.049303 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:43:17.080746 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:43:17.118114 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:43:17.176129 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:43:17.201508 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:43:17.230564 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:43:17.777027 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:43:17.826055 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:17.837427 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:43:17.897326 tst mo_mt_call.py: using LAC 18198 01:43:18.016447 tst mo_mt_call.py: using RAC 93 01:43:18.135350 tst mo_mt_call.py: using CellId 18198 01:43:18.254923 tst mo_mt_call.py: using BVCI 18199 01:43:18.366779 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:18.378158 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:18.389176 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:18.400388 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:18.411668 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:18.422956 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:43:18.542964 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:43:18.658654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:19.127604 run create_hlr_db(pid=8237): Launched 01:43:19.243303 bus /sierra_2: Setting Powered False 01:43:20.303824 run create_hlr_db(pid=8237): Terminated: ok {rc=0} 01:43:20.747000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8239): Launched 01:43:21.071816 run osmo-hlr_10.42.42.2(pid=8240): Launched 01:43:21.195567 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:21.752265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8242): Launched 01:43:22.077021 run osmo-stp_10.42.42.5(pid=8243): Launched 01:43:22.200261 run osmo-msc_10.42.42.6: Starting osmo-msc 01:43:22.791247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8245): Launched 01:43:23.116248 run osmo-msc_10.42.42.6(pid=8246): Launched 01:43:23.298847 run osmo-stp_10.42.42.5(pid=8243): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8243)] 01:43:23.435483 run osmo-stp_10.42.42.5(pid=8243): stdout: | (launched: 2022-12-09_01:43:22.017551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:23.572306 run osmo-stp_10.42.42.5(pid=8243): stderr: | 20221209014322211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014322212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014322212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014322212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014322213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014322213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014322213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:23.708206 run osmo-stp_10.42.42.5(pid=8243): stdout: | (launched: 2022-12-09_01:43:22.017551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:23.836887 run osmo-stp_10.42.42.5(pid=8243): stderr: | 20221209014322211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014322212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014322212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014322212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014322213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014322213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014322213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:23.991016 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8243): Process ended prematurely: osmo-stp_10.42.42.5(pid=8243) [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8243)] [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:43:24.000742 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:43:24.029091 run osmo-hlr_10.42.42.2(pid=8240): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8240)] 01:43:24.079661 run osmo-hlr_10.42.42.2(pid=8240): stdout: | (launched: 2022-12-09_01:43:21.012534) 01:43:24.132038 run osmo-hlr_10.42.42.2(pid=8240): stderr: | 20221209014321210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014321210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014321210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014321210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014321211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014321211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014321223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014321233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014321233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014321233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:24.205174 run osmo-msc_10.42.42.6(pid=8246): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8246)] 01:43:24.255299 run osmo-msc_10.42.42.6(pid=8246): stdout: | (launched: 2022-12-09_01:43:23.056742) 01:43:24.307564 run osmo-msc_10.42.42.6(pid=8246): stderr: | 20221209014323380 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014323380 DLGLOBAL DEBUG validating counter group 0x7f1a9799ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014323380 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014323380 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014323380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014323381 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014323382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014323383 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014323383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014323383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:43:24.360785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8239): Terminating (SIGTERM) 01:43:24.402553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8242): Terminating (SIGTERM) 01:43:24.444045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8245): Terminating (SIGTERM) 01:43:24.486153 --- ParallelTerminationStrategy: PID 8239 died... 01:43:24.506275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8239): Terminated: ok {rc=0} 01:43:24.552919 --- ParallelTerminationStrategy: PID 8242 died... 01:43:24.572797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8242): Terminated: ok {rc=0} 01:43:24.619116 --- ParallelTerminationStrategy: PID 8245 died... 01:43:24.638850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8245): Terminated: ok {rc=0} 01:43:24.727113 bus /sierra_3: Setting Powered False 01:43:25.826953 bus /sierra_3: Setting Powered False 01:43:26.942794 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:43:28.092300 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:28.104719 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:43:28.167336 tst mo_mt_call_osmux.py: using LAC 18199 01:43:28.299190 tst mo_mt_call_osmux.py: using RAC 94 01:43:28.418756 tst mo_mt_call_osmux.py: using CellId 18199 01:43:28.536002 tst mo_mt_call_osmux.py: using BVCI 18200 01:43:28.646046 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:28.657430 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:28.668728 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:28.680226 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:28.692096 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:28.703447 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:43:28.823212 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:43:28.939899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:29.409447 run create_hlr_db(pid=8248): Launched 01:43:29.525552 bus /sierra_2: Setting Powered False 01:43:30.586299 run create_hlr_db(pid=8248): Terminated: ok {rc=0} 01:43:31.054978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8250): Launched 01:43:31.381431 run osmo-hlr_10.42.42.2(pid=8251): Launched 01:43:31.653407 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:32.334914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8253): Launched 01:43:32.638866 run osmo-stp_10.42.42.5(pid=8254): Launched 01:43:32.754211 run osmo-msc_10.42.42.6: Starting osmo-msc 01:43:33.301691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8256): Launched 01:43:33.606252 run osmo-msc_10.42.42.6(pid=8257): Launched 01:43:33.775735 run osmo-stp_10.42.42.5(pid=8254): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8254)] 01:43:33.903825 run osmo-stp_10.42.42.5(pid=8254): stdout: | (launched: 2022-12-09_01:43:32.583409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:34.032142 run osmo-stp_10.42.42.5(pid=8254): stderr: | 20221209014332754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014332755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014332755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014332755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014332756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014332756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014332756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:34.158315 run osmo-stp_10.42.42.5(pid=8254): stdout: | (launched: 2022-12-09_01:43:32.583409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:34.278816 run osmo-stp_10.42.42.5(pid=8254): stderr: | 20221209014332754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014332755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014332755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014332755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014332756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014332756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014332756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:34.423372 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8254): Process ended prematurely: osmo-stp_10.42.42.5(pid=8254) [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8254)] [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:43:34.432219 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 01:43:34.459245 run osmo-hlr_10.42.42.2(pid=8251): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8251)] 01:43:34.507260 run osmo-hlr_10.42.42.2(pid=8251): stdout: | (launched: 2022-12-09_01:43:31.323422) 01:43:34.556923 run osmo-hlr_10.42.42.2(pid=8251): stderr: | 20221209014331598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014331598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014331598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014331598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014331598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014331598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014331609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014331626 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014331626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014331626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:34.626322 run osmo-msc_10.42.42.6(pid=8257): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8257)] 01:43:34.674164 run osmo-msc_10.42.42.6(pid=8257): stdout: | (launched: 2022-12-09_01:43:33.549937) 01:43:34.723609 run osmo-msc_10.42.42.6(pid=8257): stderr: | 20221209014333822 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014333822 DLGLOBAL DEBUG validating counter group 0x7f34e9fcfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014333822 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014333822 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014333822 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014333823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014333824 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014333825 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014333825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014333825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:43:34.773438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8250): Terminating (SIGTERM) 01:43:34.812871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8253): Terminating (SIGTERM) 01:43:34.852423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8256): Terminating (SIGTERM) 01:43:34.892181 --- ParallelTerminationStrategy: PID 8250 died... 01:43:34.911222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8250): Terminated: ok {rc=0} 01:43:34.955345 --- ParallelTerminationStrategy: PID 8253 died... 01:43:34.973954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8253): Terminated: ok {rc=0} 01:43:35.017762 --- ParallelTerminationStrategy: PID 8256 died... 01:43:35.036283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8256): Terminated: ok {rc=0} 01:43:35.120792 bus /sierra_3: Setting Powered False 01:43:36.219155 bus /sierra_3: Setting Powered False 01:43:37.337282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 emergency:nanobts+band-1900 --------------------------------------------------------------------- 01:43:38.575957 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:43:38.582688 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:43:38.607087 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 01:43:38.634415 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 01:43:38.722304 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:43:38.747427 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 01:43:38.774904 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 01:43:39.360098 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2352 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 01:43:39.365322 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:39.376364 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:43:39.415914 tst emergency_mo_mt_call.py: using LAC 18200 01:43:39.540247 tst emergency_mo_mt_call.py: using RAC 95 01:43:39.658593 tst emergency_mo_mt_call.py: using CellId 18200 01:43:39.776229 tst emergency_mo_mt_call.py: using BVCI 18201 01:43:39.884420 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:39.895217 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:39.905996 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:39.916657 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:39.927439 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:39.938146 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:40.057385 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:40.171873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:40.632791 run create_hlr_db(pid=8262): Launched 01:43:40.746474 bus /sierra_2: Setting Powered False 01:43:41.805888 run create_hlr_db(pid=8262): Terminated: ok {rc=0} 01:43:42.242543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8264): Launched 01:43:42.561919 run osmo-hlr_10.42.42.2(pid=8265): Launched 01:43:42.684716 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:43.232663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8267): Launched 01:43:43.550032 run osmo-stp_10.42.42.5(pid=8268): Launched 01:43:43.687806 tst emergency_mo_mt_call.py: using MSISDN 6956 01:43:43.852808 run osmo-msc_10.42.42.6: Starting osmo-msc 01:43:44.426550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8270): Launched 01:43:44.747546 run osmo-msc_10.42.42.6(pid=8271): Launched 01:43:44.925324 run osmo-stp_10.42.42.5(pid=8268): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8268)] 01:43:45.059810 run osmo-stp_10.42.42.5(pid=8268): stdout: | (launched: 2022-12-09_01:43:43.491848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:45.195266 run osmo-stp_10.42.42.5(pid=8268): stderr: | 20221209014343681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014343681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014343681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014343682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014343682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014343682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014343682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:45.329446 run osmo-stp_10.42.42.5(pid=8268): stdout: | (launched: 2022-12-09_01:43:43.491848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:45.456219 run osmo-stp_10.42.42.5(pid=8268): stderr: | 20221209014343681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014343681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014343681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014343682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014343682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014343682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014343682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:45.608040 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8268): Process ended prematurely: osmo-stp_10.42.42.5(pid=8268) [trial-2352↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8268)] [trial-2352↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 01:43:45.616897 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 01:43:45.644553 run osmo-hlr_10.42.42.2(pid=8265): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8265)] 01:43:45.694897 run osmo-hlr_10.42.42.2(pid=8265): stdout: | (launched: 2022-12-09_01:43:42.503886) 01:43:45.747356 run osmo-hlr_10.42.42.2(pid=8265): stderr: | 20221209014342698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014342699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014342699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014342699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014342699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014342699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014342710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014342719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014342719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014342719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:45.820351 run osmo-msc_10.42.42.6(pid=8271): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8271)] 01:43:45.894659 run osmo-msc_10.42.42.6(pid=8271): stdout: | (launched: 2022-12-09_01:43:44.689105) 01:43:45.951254 run osmo-msc_10.42.42.6(pid=8271): stderr: | 20221209014345010 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014345010 DLGLOBAL DEBUG validating counter group 0x7fe5e9a16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014345010 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014345010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014345010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014345011 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014345012 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014345013 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014345013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014345013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:43:46.005114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8264): Terminating (SIGTERM) 01:43:46.049294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8267): Terminating (SIGTERM) 01:43:46.095042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8270): Terminating (SIGTERM) 01:43:46.142351 --- ParallelTerminationStrategy: PID 8264 died... 01:43:46.162834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8264): Terminated: ok {rc=0} 01:43:46.213328 --- ParallelTerminationStrategy: PID 8267 died... 01:43:46.233694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8267): Terminated: ok {rc=0} 01:43:46.282455 --- ParallelTerminationStrategy: PID 8270 died... 01:43:46.302723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8270): Terminated: ok {rc=0} 01:43:46.394057 bus /sierra_3: Setting Powered False 01:43:47.491496 bus /sierra_3: Setting Powered False 01:43:48.609105 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 01:43:49.697736 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:49.709819 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:43:49.753532 tst emergency_preemptive_call.py: using LAC 18201 01:43:49.880820 tst emergency_preemptive_call.py: using RAC 96 01:43:50.010835 tst emergency_preemptive_call.py: using CellId 18201 01:43:50.136253 tst emergency_preemptive_call.py: using BVCI 18202 01:43:50.247605 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:50.258703 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:50.269500 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:50.281248 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:50.292690 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:50.304348 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:50.419700 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:50.541172 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:50.654903 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:50.769109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:51.232421 run create_hlr_db(pid=8273): Launched 01:43:51.346936 bus /sierra_2: Setting Powered False 01:43:52.410453 run create_hlr_db(pid=8273): Terminated: ok {rc=0} 01:43:52.856931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8275): Launched 01:43:53.176372 run osmo-hlr_10.42.42.2(pid=8276): Launched 01:43:53.299240 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:53.852152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8278): Launched 01:43:54.171763 run osmo-stp_10.42.42.5(pid=8279): Launched 01:43:54.302624 tst emergency_preemptive_call.py: using MSISDN 6957 01:43:54.466402 run osmo-msc_10.42.42.6: Starting osmo-msc 01:43:55.040079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8281): Launched 01:43:55.361199 run osmo-msc_10.42.42.6(pid=8282): Launched 01:43:55.538982 run osmo-stp_10.42.42.5(pid=8279): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8279)] 01:43:55.673268 run osmo-stp_10.42.42.5(pid=8279): stdout: | (launched: 2022-12-09_01:43:54.113455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:55.808076 run osmo-stp_10.42.42.5(pid=8279): stderr: | 20221209014354303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014354303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014354303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014354303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014354304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014354304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014354304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:55.942523 run osmo-stp_10.42.42.5(pid=8279): stdout: | (launched: 2022-12-09_01:43:54.113455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:56.070159 run osmo-stp_10.42.42.5(pid=8279): stderr: | 20221209014354303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014354303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014354303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014354303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014354304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014354304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014354304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:56.222226 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8279): Process ended prematurely: osmo-stp_10.42.42.5(pid=8279) [trial-2352↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8279)] [trial-2352↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 01:43:56.231171 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 01:43:56.259223 run osmo-hlr_10.42.42.2(pid=8276): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8276)] 01:43:56.309824 run osmo-hlr_10.42.42.2(pid=8276): stdout: | (launched: 2022-12-09_01:43:53.117911) 01:43:56.362326 run osmo-hlr_10.42.42.2(pid=8276): stderr: | 20221209014353314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014353314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014353314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014353314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014353314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014353314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014353326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014353334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014353334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014353334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:56.435561 run osmo-msc_10.42.42.6(pid=8282): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8282)] 01:43:56.486145 run osmo-msc_10.42.42.6(pid=8282): stdout: | (launched: 2022-12-09_01:43:55.302218) 01:43:56.538518 run osmo-msc_10.42.42.6(pid=8282): stderr: | 20221209014355625 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014355625 DLGLOBAL DEBUG validating counter group 0x7f3b2814fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014355625 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014355625 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014355625 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014355626 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014355627 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014355628 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014355628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014355628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:43:56.591693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8275): Terminating (SIGTERM) 01:43:56.634025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8278): Terminating (SIGTERM) 01:43:56.676619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8281): Terminating (SIGTERM) 01:43:56.719342 --- ParallelTerminationStrategy: PID 8275 died... 01:43:56.739625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8275): Terminated: ok {rc=0} 01:43:56.786249 --- ParallelTerminationStrategy: PID 8278 died... 01:43:56.805973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8278): Terminated: ok {rc=0} 01:43:56.852605 --- ParallelTerminationStrategy: PID 8281 died... 01:43:56.872526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8281): Terminated: ok {rc=0} 01:43:56.961926 bus /sierra_9: Setting Powered False 01:43:58.064294 bus /sierra_9: Setting Powered False 01:43:59.178899 bus /sierra_8: Setting Powered False 01:44:00.278296 bus /sierra_8: Setting Powered False 01:44:01.396758 bus /sierra_3: Setting Powered False 01:44:02.500063 bus /sierra_3: Setting Powered False 01:44:03.616042 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-1900 --------------------------------------------------------------------- 01:44:04.885229 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:44:04.890373 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:44:04.915067 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 01:44:04.953010 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 01:44:05.036499 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:44:05.059813 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 01:44:05.097813 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 01:44:05.695001 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 01:44:05.748147 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:05.759781 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:44:05.798661 tst cs_paging_gprs_active.py: using LAC 18202 01:44:05.926528 tst cs_paging_gprs_active.py: using RAC 97 01:44:06.052650 tst cs_paging_gprs_active.py: using CellId 18202 01:44:06.172695 tst cs_paging_gprs_active.py: using BVCI 18203 01:44:06.283425 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:06.294401 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:06.304928 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:06.315797 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:06.326989 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:06.337645 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:06.348375 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:06.359033 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:06.369916 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:06.489489 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:06.609085 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:44:06.828895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:07.155185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8287): Launched 01:44:07.439459 run iperf3-srv_10.42.42.10(pid=8288): Launched 01:44:07.562018 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:44:07.780922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:08.108743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8289): Launched 01:44:08.391692 run iperf3-srv_10.42.42.10(pid=8290): Launched 01:44:08.514167 tst cs_paging_gprs_active.py:38: start network... 01:44:08.734205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:09.239134 run create_hlr_db(pid=8291): Launched 01:44:09.373907 bus /sierra_2: Setting Powered False 01:44:10.438523 run create_hlr_db(pid=8291): Terminated: ok {rc=0} 01:44:10.873292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8293): Launched 01:44:11.178323 run osmo-hlr_10.42.42.2(pid=8294): Launched 01:44:11.295121 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:11.833754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8296): Launched 01:44:12.139638 run osmo-stp_10.42.42.5(pid=8300): Launched 01:44:12.255676 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:12.780380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8302): Launched 01:44:12.898238 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:13.155730 run patchelf(pid=8303): Launched 01:44:13.326169 run osmo-stp_10.42.42.5(pid=8300): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8300)] 01:44:13.455362 run osmo-stp_10.42.42.5(pid=8300): stdout: | (launched: 2022-12-09_01:44:12.083333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:13.586433 run osmo-stp_10.42.42.5(pid=8300): stderr: | 20221209014412251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014412251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014412251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014412252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014412252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014412252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014412252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:13.717593 run osmo-stp_10.42.42.5(pid=8300): stdout: | (launched: 2022-12-09_01:44:12.083333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:13.842502 run osmo-stp_10.42.42.5(pid=8300): stderr: | 20221209014412251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014412251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014412251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014412252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014412252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014412252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014412252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:13.990331 run patchelf(pid=8303): Terminating (SIGINT) 01:44:14.161427 run patchelf(pid=8303): Terminated: ok {rc=0} 01:44:14.285141 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8300): Process ended prematurely: osmo-stp_10.42.42.5(pid=8300) [trial-2352↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8300)] [trial-2352↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 01:44:14.294665 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 01:44:14.322489 run osmo-hlr_10.42.42.2(pid=8294): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8294)] 01:44:14.370668 run osmo-hlr_10.42.42.2(pid=8294): stdout: | (launched: 2022-12-09_01:44:11.122348) 01:44:14.420631 run osmo-hlr_10.42.42.2(pid=8294): stderr: | 20221209014411298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014411298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014411298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014411298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014411298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014411298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014411310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014411318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014411318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014411318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:14.470936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8287): Terminating (SIGTERM) 01:44:14.511051 run iperf3-srv_10.42.42.10(pid=8288): Terminating (SIGTERM) 01:44:14.551013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8289): Terminating (SIGTERM) 01:44:14.591105 run iperf3-srv_10.42.42.10(pid=8290): Terminating (SIGTERM) 01:44:14.631149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8293): Terminating (SIGTERM) 01:44:14.671124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8296): Terminating (SIGTERM) 01:44:14.711257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8302): Terminating (SIGTERM) 01:44:14.751504 --- ParallelTerminationStrategy: PID 8287 died... 01:44:14.770709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8287): Terminated: ok {rc=0} 01:44:14.815318 --- ParallelTerminationStrategy: PID 8288 died... 01:44:14.833823 run iperf3-srv_10.42.42.10(pid=8288): Terminated {rc=256} 01:44:14.878071 --- ParallelTerminationStrategy: PID 8289 died... 01:44:14.896652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8289): Terminated: ok {rc=0} 01:44:14.940904 --- ParallelTerminationStrategy: PID 8290 died... 01:44:14.959917 run iperf3-srv_10.42.42.10(pid=8290): Terminated {rc=256} 01:44:15.004126 --- ParallelTerminationStrategy: PID 8293 died... 01:44:15.022698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8293): Terminated: ok {rc=0} 01:44:15.066831 --- ParallelTerminationStrategy: PID 8296 died... 01:44:15.085440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8296): Terminated: ok {rc=0} 01:44:15.129448 --- ParallelTerminationStrategy: PID 8302 died... 01:44:15.148101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8302): Terminated: ok {rc=0} 01:44:15.231453 bus /gobi_0: Setting Powered False 01:44:16.332664 bus /gobi_0: Setting Powered False 01:44:17.447676 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 01:44:18.597292 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:18.609227 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:44:18.649418 tst iperf3.py: using LAC 18203 01:44:18.777787 tst iperf3.py: using RAC 98 01:44:18.903979 tst iperf3.py: using CellId 18203 01:44:19.030502 tst iperf3.py: using BVCI 18204 01:44:19.149853 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:19.161149 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:19.172163 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:19.183203 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:19.194164 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:19.205098 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:19.216189 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:19.227170 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:19.238270 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:19.356877 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:44:19.561074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:19.865141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8304): Launched 01:44:20.131381 run iperf3-srv_10.42.42.10(pid=8305): Launched 01:44:20.246138 tst iperf3.py:8: start network... 01:44:20.449575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:20.921570 run create_hlr_db(pid=8306): Launched 01:44:21.039224 bus /gobi_6: Setting Powered False 01:44:22.099892 run create_hlr_db(pid=8306): Terminated: ok {rc=0} 01:44:22.522658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8308): Launched 01:44:22.829148 run osmo-hlr_10.42.42.2(pid=8309): Launched 01:44:22.948159 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:23.473409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8311): Launched 01:44:23.778860 run osmo-stp_10.42.42.5(pid=8312): Launched 01:44:23.894933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:24.419858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8314): Launched 01:44:24.546360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:24.823428 run patchelf(pid=8315): Launched 01:44:25.004265 run osmo-stp_10.42.42.5(pid=8312): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8312)] 01:44:25.142793 run osmo-stp_10.42.42.5(pid=8312): stdout: | (launched: 2022-12-09_01:44:23.722373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:25.281999 run osmo-stp_10.42.42.5(pid=8312): stderr: | 20221209014423892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014423892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014423892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014423892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014423893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014423893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014423893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:25.421466 run osmo-stp_10.42.42.5(pid=8312): stdout: | (launched: 2022-12-09_01:44:23.722373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:25.554130 run osmo-stp_10.42.42.5(pid=8312): stderr: | 20221209014423892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014423892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014423892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014423892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014423893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014423893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014423893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:25.711398 run patchelf(pid=8315): Terminating (SIGINT) 01:44:25.893677 run patchelf(pid=8315): Terminated: ok {rc=0} 01:44:26.025644 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8312): Process ended prematurely: osmo-stp_10.42.42.5(pid=8312) [trial-2352↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8312)] [trial-2352↪gprs:nanobts+band-1900↪iperf3.py:8] 01:44:26.035850 tst iperf3.py:8: Test FAILED (7.5 sec) 01:44:26.065306 run osmo-hlr_10.42.42.2(pid=8309): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8309)] 01:44:26.115701 run osmo-hlr_10.42.42.2(pid=8309): stdout: | (launched: 2022-12-09_01:44:22.772884) 01:44:26.167627 run osmo-hlr_10.42.42.2(pid=8309): stderr: | 20221209014422948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014422948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014422948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014422948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014422948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014422948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014422959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014422968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014422968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014422968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:26.220003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8304): Terminating (SIGTERM) 01:44:26.262042 run iperf3-srv_10.42.42.10(pid=8305): Terminating (SIGTERM) 01:44:26.303879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8308): Terminating (SIGTERM) 01:44:26.345833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8311): Terminating (SIGTERM) 01:44:26.387640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8314): Terminating (SIGTERM) 01:44:26.429701 --- ParallelTerminationStrategy: PID 8304 died... 01:44:26.449909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8304): Terminated: ok {rc=0} 01:44:26.496310 --- ParallelTerminationStrategy: PID 8305 died... 01:44:26.515976 run iperf3-srv_10.42.42.10(pid=8305): Terminated {rc=256} 01:44:26.562157 --- ParallelTerminationStrategy: PID 8308 died... 01:44:26.581739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8308): Terminated: ok {rc=0} 01:44:26.627829 --- ParallelTerminationStrategy: PID 8311 died... 01:44:26.647502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8311): Terminated: ok {rc=0} 01:44:26.693576 --- ParallelTerminationStrategy: PID 8314 died... 01:44:26.713347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8314): Terminated: ok {rc=0} 01:44:26.801776 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 01:44:27.951655 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:27.967027 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:44:28.005114 tst iperf3m4.py: using LAC 18204 01:44:28.141341 tst iperf3m4.py: using RAC 99 01:44:28.280765 tst iperf3m4.py: using CellId 18204 01:44:28.408560 tst iperf3m4.py: using BVCI 18205 01:44:28.526088 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.537154 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.548067 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.559014 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.569953 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.580802 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.591783 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.602730 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.613792 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:28.731058 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:28.848407 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:28.969822 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:29.091142 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:44:29.296117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:29.602916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8316): Launched 01:44:29.867821 run iperf3-srv_10.42.42.10(pid=8317): Launched 01:44:29.981847 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:44:30.185066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:30.490096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8318): Launched 01:44:30.755311 run iperf3-srv_10.42.42.10(pid=8319): Launched 01:44:30.887320 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:44:31.094110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:31.405719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8320): Launched 01:44:31.713728 run iperf3-srv_10.42.42.10(pid=8321): Launched 01:44:31.836681 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:44:32.043246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:32.351198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8322): Launched 01:44:32.615627 run iperf3-srv_10.42.42.10(pid=8323): Launched 01:44:32.729577 tst iperf3m4.py:8: start network... 01:44:32.932365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:33.401309 run create_hlr_db(pid=8324): Launched 01:44:33.518206 bus /gobi_6: Setting Powered False 01:44:34.582890 run create_hlr_db(pid=8324): Terminated: ok {rc=0} 01:44:35.036889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8326): Launched 01:44:35.362904 run osmo-hlr_10.42.42.2(pid=8327): Launched 01:44:35.486125 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:36.050169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8329): Launched 01:44:36.377896 run osmo-stp_10.42.42.5(pid=8330): Launched 01:44:36.501370 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:37.064310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8332): Launched 01:44:37.190612 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:37.465864 run patchelf(pid=8333): Launched 01:44:37.649564 run osmo-stp_10.42.42.5(pid=8330): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8330)] 01:44:37.788033 run osmo-stp_10.42.42.5(pid=8330): stdout: | (launched: 2022-12-09_01:44:36.317671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:37.927697 run osmo-stp_10.42.42.5(pid=8330): stderr: | 20221209014436506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014436506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014436507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014436507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014436508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014436508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014436508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:38.067901 run osmo-stp_10.42.42.5(pid=8330): stdout: | (launched: 2022-12-09_01:44:36.317671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:38.201346 run osmo-stp_10.42.42.5(pid=8330): stderr: | 20221209014436506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014436506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014436507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014436507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014436508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014436508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014436508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:38.359570 run patchelf(pid=8333): Terminating (SIGINT) 01:44:38.542537 run patchelf(pid=8333): Terminated: ok {rc=0} 01:44:38.674333 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8330): Process ended prematurely: osmo-stp_10.42.42.5(pid=8330) [trial-2352↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8330)] [trial-2352↪gprs:nanobts+band-1900↪iperf3m4.py:8] 01:44:38.684542 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:44:38.713502 run osmo-hlr_10.42.42.2(pid=8327): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8327)] 01:44:38.763679 run osmo-hlr_10.42.42.2(pid=8327): stdout: | (launched: 2022-12-09_01:44:35.303158) 01:44:38.815658 run osmo-hlr_10.42.42.2(pid=8327): stderr: | 20221209014435498 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014435498 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014435499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014435499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014435499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014435499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014435512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014435522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014435523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014435523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:38.867923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8316): Terminating (SIGTERM) 01:44:38.910414 run iperf3-srv_10.42.42.10(pid=8317): Terminating (SIGTERM) 01:44:38.952480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8318): Terminating (SIGTERM) 01:44:38.994626 run iperf3-srv_10.42.42.10(pid=8319): Terminating (SIGTERM) 01:44:39.036471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8320): Terminating (SIGTERM) 01:44:39.078987 run iperf3-srv_10.42.42.10(pid=8321): Terminating (SIGTERM) 01:44:39.121076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8322): Terminating (SIGTERM) 01:44:39.163147 run iperf3-srv_10.42.42.10(pid=8323): Terminating (SIGTERM) 01:44:39.205043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8326): Terminating (SIGTERM) 01:44:39.247080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8329): Terminating (SIGTERM) 01:44:39.289051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8332): Terminating (SIGTERM) 01:44:39.331458 --- ParallelTerminationStrategy: PID 8316 died... 01:44:39.351799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8316): Terminated: ok {rc=0} 01:44:39.399075 --- ParallelTerminationStrategy: PID 8317 died... 01:44:39.418912 run iperf3-srv_10.42.42.10(pid=8317): Terminated {rc=256} 01:44:39.465621 --- ParallelTerminationStrategy: PID 8318 died... 01:44:39.485383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8318): Terminated: ok {rc=0} 01:44:39.532040 --- ParallelTerminationStrategy: PID 8319 died... 01:44:39.551846 run iperf3-srv_10.42.42.10(pid=8319): Terminated {rc=256} 01:44:39.598203 --- ParallelTerminationStrategy: PID 8320 died... 01:44:39.617880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8320): Terminated: ok {rc=0} 01:44:39.664179 --- ParallelTerminationStrategy: PID 8321 died... 01:44:39.683826 run iperf3-srv_10.42.42.10(pid=8321): Terminated {rc=256} 01:44:39.730117 --- ParallelTerminationStrategy: PID 8322 died... 01:44:39.749850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8322): Terminated: ok {rc=0} 01:44:39.796138 --- ParallelTerminationStrategy: PID 8323 died... 01:44:39.815725 run iperf3-srv_10.42.42.10(pid=8323): Terminated {rc=256} 01:44:39.862073 --- ParallelTerminationStrategy: PID 8326 died... 01:44:39.881721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8326): Terminated: ok {rc=0} 01:44:39.927860 --- ParallelTerminationStrategy: PID 8329 died... 01:44:39.947627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8329): Terminated: ok {rc=0} 01:44:39.994203 --- ParallelTerminationStrategy: PID 8332 died... 01:44:40.013943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8332): Terminated: ok {rc=0} 01:44:40.101969 bus /gobi_4: Setting Powered False 01:44:41.200726 bus /gobi_4: Setting Powered False 01:44:42.319377 bus /gobi_1: Setting Powered False 01:44:43.419060 bus /gobi_1: Setting Powered False 01:44:44.535544 bus /gobi_0: Setting Powered False 01:44:45.634976 bus /gobi_0: Setting Powered False 01:44:46.753362 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 01:44:47.854265 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:47.865471 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:44:47.906190 tst ping.py: using LAC 18205 01:44:48.025929 tst ping.py: using RAC 100 01:44:48.143118 tst ping.py: using CellId 18205 01:44:48.261494 tst ping.py: using BVCI 18206 01:44:48.378154 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:48.389494 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:48.400680 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:48.412389 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:48.423457 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:48.434610 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:48.445749 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:48.456668 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:48.569363 tst ping.py:19: start network... 01:44:48.770106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:49.230838 run create_hlr_db(pid=8334): Launched 01:44:49.344611 bus /gobi_6: Setting Powered False 01:44:50.407916 run create_hlr_db(pid=8334): Terminated: ok {rc=0} 01:44:50.851771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8336): Launched 01:44:51.172415 run osmo-hlr_10.42.42.2(pid=8337): Launched 01:44:51.294762 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:51.851096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8339): Launched 01:44:52.171836 run osmo-stp_10.42.42.5(pid=8340): Launched 01:44:52.293815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:52.845708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8342): Launched 01:44:52.970025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:53.241858 run patchelf(pid=8343): Launched 01:44:53.420868 run osmo-stp_10.42.42.5(pid=8340): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8340)] 01:44:53.556329 run osmo-stp_10.42.42.5(pid=8340): stdout: | (launched: 2022-12-09_01:44:52.112901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:53.693497 run osmo-stp_10.42.42.5(pid=8340): stderr: | 20221209014452303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014452303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014452304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014452304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014452304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014452305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014452305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:53.830673 run osmo-stp_10.42.42.5(pid=8340): stdout: | (launched: 2022-12-09_01:44:52.112901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:53.961245 run osmo-stp_10.42.42.5(pid=8340): stderr: | 20221209014452303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014452303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014452304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014452304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014452304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014452305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014452305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:54.116804 run patchelf(pid=8343): Terminating (SIGINT) 01:44:54.295808 run patchelf(pid=8343): Terminated: ok {rc=0} 01:44:54.424768 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8340): Process ended prematurely: osmo-stp_10.42.42.5(pid=8340) [trial-2352↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8340)] [trial-2352↪gprs:nanobts+band-1900↪ping.py:22] 01:44:54.434280 tst ping.py:22: Test FAILED (6.6 sec) 01:44:54.462503 run osmo-hlr_10.42.42.2(pid=8337): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8337)] 01:44:54.512731 run osmo-hlr_10.42.42.2(pid=8337): stdout: | (launched: 2022-12-09_01:44:51.114126) 01:44:54.564618 run osmo-hlr_10.42.42.2(pid=8337): stderr: | 20221209014451311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014451311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014451311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014451311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014451311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014451311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014451323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014451331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014451332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014451332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:54.616758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8336): Terminating (SIGTERM) 01:44:54.658696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8339): Terminating (SIGTERM) 01:44:54.700553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8342): Terminating (SIGTERM) 01:44:54.742768 --- ParallelTerminationStrategy: PID 8336 died... 01:44:54.762994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8336): Terminated: ok {rc=0} 01:44:54.809693 --- ParallelTerminationStrategy: PID 8339 died... 01:44:54.829469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8339): Terminated: ok {rc=0} 01:44:54.876056 --- ParallelTerminationStrategy: PID 8342 died... 01:44:54.895764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8342): Terminated: ok {rc=0} 01:44:54.983955 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 01:44:56.072854 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:56.084724 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:44:56.126546 tst ping_idle_ping.py: using LAC 18206 01:44:56.253170 tst ping_idle_ping.py: using RAC 101 01:44:56.378588 tst ping_idle_ping.py: using CellId 18206 01:44:56.505159 tst ping_idle_ping.py: using BVCI 18207 01:44:56.621109 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:56.632241 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:56.643241 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:56.654328 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:56.665234 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:56.676087 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:56.687168 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:56.698173 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:56.813679 tst ping_idle_ping.py:24: start network... 01:44:57.014836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:57.482042 run create_hlr_db(pid=8344): Launched 01:44:57.598985 bus /gobi_6: Setting Powered False 01:44:58.659342 run create_hlr_db(pid=8344): Terminated: ok {rc=0} 01:44:59.078436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8346): Launched 01:44:59.378700 run osmo-hlr_10.42.42.2(pid=8347): Launched 01:44:59.494190 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:00.026759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8349): Launched 01:45:00.327109 run osmo-stp_10.42.42.5(pid=8350): Launched 01:45:00.442330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:00.989246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8352): Launched 01:45:01.131728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:01.426585 run patchelf(pid=8356): Launched 01:45:01.622501 run osmo-stp_10.42.42.5(pid=8350): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8350)] 01:45:01.767514 run osmo-stp_10.42.42.5(pid=8350): stdout: | (launched: 2022-12-09_01:45:00.271906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:01.924807 run osmo-stp_10.42.42.5(pid=8350): stderr: | 20221209014500442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014500442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014500442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014500443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014500443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014500443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014500443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:02.068442 run osmo-stp_10.42.42.5(pid=8350): stdout: | (launched: 2022-12-09_01:45:00.271906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:02.203955 run osmo-stp_10.42.42.5(pid=8350): stderr: | 20221209014500442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014500442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014500442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014500443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014500443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014500443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014500443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:02.360691 run patchelf(pid=8356): Terminating (SIGINT) 01:45:02.540873 run patchelf(pid=8356): Terminated: ok {rc=0} 01:45:02.670668 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8350): Process ended prematurely: osmo-stp_10.42.42.5(pid=8350) [trial-2352↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8350)] [trial-2352↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 01:45:02.680295 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:45:02.709052 run osmo-hlr_10.42.42.2(pid=8347): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8347)] 01:45:02.759767 run osmo-hlr_10.42.42.2(pid=8347): stdout: | (launched: 2022-12-09_01:44:59.323394) 01:45:02.812188 run osmo-hlr_10.42.42.2(pid=8347): stderr: | 20221209014459496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014459496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014459497 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014459497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014459497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014459497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014459508 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014459516 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014459517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014459517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:02.865159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8346): Terminating (SIGTERM) 01:45:02.907743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8349): Terminating (SIGTERM) 01:45:02.950245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8352): Terminating (SIGTERM) 01:45:02.993361 --- ParallelTerminationStrategy: PID 8346 died... 01:45:03.013880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8346): Terminated: ok {rc=0} 01:45:03.061509 --- ParallelTerminationStrategy: PID 8349 died... 01:45:03.081728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8349): Terminated: ok {rc=0} 01:45:03.129262 --- ParallelTerminationStrategy: PID 8352 died... 01:45:03.149381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8352): Terminated: ok {rc=0} 01:45:03.238438 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 01:45:04.541380 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:45:04.548479 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:45:04.573492 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:45:04.613083 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:45:04.706251 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:45:04.730981 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:45:04.770382 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:45:05.362516 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:45:05.414641 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:05.425905 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:45:05.465487 tst cs_paging_gprs_active.py: using LAC 18207 01:45:05.588294 tst cs_paging_gprs_active.py: using RAC 102 01:45:05.715481 tst cs_paging_gprs_active.py: using CellId 18207 01:45:05.835957 tst cs_paging_gprs_active.py: using BVCI 18208 01:45:05.946626 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:05.958030 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:05.968761 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:05.980097 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:05.991368 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:06.002736 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:06.014148 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:06.025284 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:06.036483 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:06.151842 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:06.272635 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:45:06.492165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:06.818541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8360): Launched 01:45:07.102140 run iperf3-srv_10.42.42.10(pid=8361): Launched 01:45:07.225073 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:45:07.443863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:07.770061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8363): Launched 01:45:08.054001 run iperf3-srv_10.42.42.10(pid=8364): Launched 01:45:08.177150 tst cs_paging_gprs_active.py:38: start network... 01:45:08.396266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:08.900035 run create_hlr_db(pid=8365): Launched 01:45:09.033024 bus /gobi_6: Setting Powered False 01:45:10.097349 run create_hlr_db(pid=8365): Terminated: ok {rc=0} 01:45:10.531518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8367): Launched 01:45:10.838004 run osmo-hlr_10.42.42.2(pid=8368): Launched 01:45:10.954933 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:11.491571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8370): Launched 01:45:11.798626 run osmo-stp_10.42.42.5(pid=8371): Launched 01:45:11.916038 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:12.443886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8373): Launched 01:45:12.561821 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:12.819158 run patchelf(pid=8374): Launched 01:45:12.989709 run osmo-stp_10.42.42.5(pid=8371): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8371)] 01:45:13.118898 run osmo-stp_10.42.42.5(pid=8371): stdout: | (launched: 2022-12-09_01:45:11.741132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:13.250590 run osmo-stp_10.42.42.5(pid=8371): stderr: | 20221209014511910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014511910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014511910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014511911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014511911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014511911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014511911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:13.381604 run osmo-stp_10.42.42.5(pid=8371): stdout: | (launched: 2022-12-09_01:45:11.741132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:13.506017 run osmo-stp_10.42.42.5(pid=8371): stderr: | 20221209014511910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014511910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014511910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014511911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014511911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014511911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014511911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:13.653924 run patchelf(pid=8374): Terminating (SIGINT) 01:45:13.825340 run patchelf(pid=8374): Terminated: ok {rc=0} 01:45:13.948734 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8371): Process ended prematurely: osmo-stp_10.42.42.5(pid=8371) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8371)] [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:45:13.958336 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 01:45:13.985946 run osmo-hlr_10.42.42.2(pid=8368): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8368)] 01:45:14.034268 run osmo-hlr_10.42.42.2(pid=8368): stdout: | (launched: 2022-12-09_01:45:10.781636) 01:45:14.083729 run osmo-hlr_10.42.42.2(pid=8368): stderr: | 20221209014510957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014510957 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014510957 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014510957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014510957 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014510957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014510970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014510978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014510979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014510979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:14.134064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8360): Terminating (SIGTERM) 01:45:14.174296 run iperf3-srv_10.42.42.10(pid=8361): Terminating (SIGTERM) 01:45:14.214310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8363): Terminating (SIGTERM) 01:45:14.254421 run iperf3-srv_10.42.42.10(pid=8364): Terminating (SIGTERM) 01:45:14.294255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8367): Terminating (SIGTERM) 01:45:14.334115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8370): Terminating (SIGTERM) 01:45:14.374163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8373): Terminating (SIGTERM) 01:45:14.414375 --- ParallelTerminationStrategy: PID 8360 died... 01:45:14.433506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8360): Terminated: ok {rc=0} 01:45:14.478122 --- ParallelTerminationStrategy: PID 8361 died... 01:45:14.496900 run iperf3-srv_10.42.42.10(pid=8361): Terminated {rc=256} 01:45:14.541482 --- ParallelTerminationStrategy: PID 8363 died... 01:45:14.560242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8363): Terminated: ok {rc=0} 01:45:14.604841 --- ParallelTerminationStrategy: PID 8364 died... 01:45:14.623858 run iperf3-srv_10.42.42.10(pid=8364): Terminated {rc=256} 01:45:14.668158 --- ParallelTerminationStrategy: PID 8367 died... 01:45:14.686843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8367): Terminated: ok {rc=0} 01:45:14.731074 --- ParallelTerminationStrategy: PID 8370 died... 01:45:14.749817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8370): Terminated: ok {rc=0} 01:45:14.794123 --- ParallelTerminationStrategy: PID 8373 died... 01:45:14.812842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8373): Terminated: ok {rc=0} 01:45:14.898593 bus /gobi_0: Setting Powered False 01:45:16.005123 bus /gobi_0: Setting Powered False 01:45:17.133650 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:45:18.283858 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:18.295889 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:45:18.340498 tst iperf3.py: using LAC 18208 01:45:18.462503 tst iperf3.py: using RAC 103 01:45:18.584196 tst iperf3.py: using CellId 18208 01:45:18.707993 tst iperf3.py: using BVCI 18209 01:45:18.820578 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:18.831777 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:18.842746 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:18.854175 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:18.865243 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:18.876130 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:18.887317 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:18.898947 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:18.910592 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:19.023519 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:45:19.227815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:19.533152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8375): Launched 01:45:19.798567 run iperf3-srv_10.42.42.10(pid=8376): Launched 01:45:19.913424 tst iperf3.py:8: start network... 01:45:20.117574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:20.590935 run create_hlr_db(pid=8377): Launched 01:45:20.707616 bus /gobi_6: Setting Powered False 01:45:21.768657 run create_hlr_db(pid=8377): Terminated: ok {rc=0} 01:45:22.213703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8379): Launched 01:45:22.541144 run osmo-hlr_10.42.42.2(pid=8380): Launched 01:45:22.666535 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:23.234213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8382): Launched 01:45:23.561388 run osmo-stp_10.42.42.5(pid=8383): Launched 01:45:23.687107 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:24.252506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8385): Launched 01:45:24.377938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:24.653391 run patchelf(pid=8386): Launched 01:45:24.835569 run osmo-stp_10.42.42.5(pid=8383): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8383)] 01:45:24.974845 run osmo-stp_10.42.42.5(pid=8383): stdout: | (launched: 2022-12-09_01:45:23.501663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:25.115799 run osmo-stp_10.42.42.5(pid=8383): stderr: | 20221209014523695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014523695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014523695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014523696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014523696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014523696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014523696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:25.256087 run osmo-stp_10.42.42.5(pid=8383): stdout: | (launched: 2022-12-09_01:45:23.501663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:25.390960 run osmo-stp_10.42.42.5(pid=8383): stderr: | 20221209014523695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014523695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014523695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014523696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014523696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014523696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014523696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:25.549885 run patchelf(pid=8386): Terminating (SIGINT) 01:45:25.733870 run patchelf(pid=8386): Terminated: ok {rc=0} 01:45:25.866247 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8383): Process ended prematurely: osmo-stp_10.42.42.5(pid=8383) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8383)] [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 01:45:25.876443 tst iperf3.py:8: Test FAILED (7.6 sec) 01:45:25.905343 run osmo-hlr_10.42.42.2(pid=8380): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8380)] 01:45:25.955704 run osmo-hlr_10.42.42.2(pid=8380): stdout: | (launched: 2022-12-09_01:45:22.481708) 01:45:26.007832 run osmo-hlr_10.42.42.2(pid=8380): stderr: | 20221209014522679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014522679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014522679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014522679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014522680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014522680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014522693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014522702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014522703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014522703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:26.060757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8375): Terminating (SIGTERM) 01:45:26.103805 run iperf3-srv_10.42.42.10(pid=8376): Terminating (SIGTERM) 01:45:26.146434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8379): Terminating (SIGTERM) 01:45:26.188647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8382): Terminating (SIGTERM) 01:45:26.230758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8385): Terminating (SIGTERM) 01:45:26.273155 --- ParallelTerminationStrategy: PID 8375 died... 01:45:26.293317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8375): Terminated: ok {rc=0} 01:45:26.340192 --- ParallelTerminationStrategy: PID 8376 died... 01:45:26.360184 run iperf3-srv_10.42.42.10(pid=8376): Terminated {rc=256} 01:45:26.406947 --- ParallelTerminationStrategy: PID 8379 died... 01:45:26.426723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8379): Terminated: ok {rc=0} 01:45:26.473516 --- ParallelTerminationStrategy: PID 8382 died... 01:45:26.493504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8382): Terminated: ok {rc=0} 01:45:26.540151 --- ParallelTerminationStrategy: PID 8385 died... 01:45:26.560077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8385): Terminated: ok {rc=0} 01:45:26.648465 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:45:27.799929 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:27.812084 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:45:27.853614 tst iperf3m4.py: using LAC 18209 01:45:27.982981 tst iperf3m4.py: using RAC 104 01:45:28.112710 tst iperf3m4.py: using CellId 18209 01:45:28.242136 tst iperf3m4.py: using BVCI 18210 01:45:28.361515 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.373234 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.384648 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.396184 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.407776 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.419172 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.430853 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.442311 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.453911 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:28.570178 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:28.692225 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:28.812832 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:28.932789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:45:29.154190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:29.482036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8387): Launched 01:45:29.768745 run iperf3-srv_10.42.42.10(pid=8388): Launched 01:45:29.891347 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:45:30.111811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:30.439471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8389): Launched 01:45:30.726594 run iperf3-srv_10.42.42.10(pid=8390): Launched 01:45:30.854988 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:45:31.086052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:31.431907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8391): Launched 01:45:31.721604 run iperf3-srv_10.42.42.10(pid=8392): Launched 01:45:31.859005 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:45:32.083806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:32.414240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8393): Launched 01:45:32.698765 run iperf3-srv_10.42.42.10(pid=8394): Launched 01:45:32.821396 tst iperf3m4.py:8: start network... 01:45:33.041331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:33.548665 run create_hlr_db(pid=8395): Launched 01:45:33.682748 bus /gobi_6: Setting Powered False 01:45:34.748511 run create_hlr_db(pid=8395): Terminated: ok {rc=0} 01:45:35.184385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8397): Launched 01:45:35.490799 run osmo-hlr_10.42.42.2(pid=8398): Launched 01:45:35.610095 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:36.148026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8400): Launched 01:45:36.454442 run osmo-stp_10.42.42.5(pid=8401): Launched 01:45:36.574025 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:37.098864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8403): Launched 01:45:37.217207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:37.475076 run patchelf(pid=8404): Launched 01:45:37.646247 run osmo-stp_10.42.42.5(pid=8401): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8401)] 01:45:37.775866 run osmo-stp_10.42.42.5(pid=8401): stdout: | (launched: 2022-12-09_01:45:36.398162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:37.906783 run osmo-stp_10.42.42.5(pid=8401): stderr: | 20221209014536565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014536565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014536566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014536566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014536567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014536567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014536567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:38.037177 run osmo-stp_10.42.42.5(pid=8401): stdout: | (launched: 2022-12-09_01:45:36.398162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:38.161979 run osmo-stp_10.42.42.5(pid=8401): stderr: | 20221209014536565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014536565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014536566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014536566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014536567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014536567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014536567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:38.309620 run patchelf(pid=8404): Terminating (SIGINT) 01:45:38.481334 run patchelf(pid=8404): Terminated: ok {rc=0} 01:45:38.605322 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8401): Process ended prematurely: osmo-stp_10.42.42.5(pid=8401) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8401)] [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 01:45:38.614847 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:45:38.643056 run osmo-hlr_10.42.42.2(pid=8398): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8398)] 01:45:38.690829 run osmo-hlr_10.42.42.2(pid=8398): stdout: | (launched: 2022-12-09_01:45:35.434714) 01:45:38.740429 run osmo-hlr_10.42.42.2(pid=8398): stderr: | 20221209014535608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014535608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014535608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014535608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014535608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014535608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014535620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014535628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014535628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014535628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:38.790500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8387): Terminating (SIGTERM) 01:45:38.830805 run iperf3-srv_10.42.42.10(pid=8388): Terminating (SIGTERM) 01:45:38.870973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8389): Terminating (SIGTERM) 01:45:38.911138 run iperf3-srv_10.42.42.10(pid=8390): Terminating (SIGTERM) 01:45:38.951075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8391): Terminating (SIGTERM) 01:45:38.991057 run iperf3-srv_10.42.42.10(pid=8392): Terminating (SIGTERM) 01:45:39.031071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8393): Terminating (SIGTERM) 01:45:39.071138 run iperf3-srv_10.42.42.10(pid=8394): Terminating (SIGTERM) 01:45:39.110950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8397): Terminating (SIGTERM) 01:45:39.151191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8400): Terminating (SIGTERM) 01:45:39.191120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8403): Terminating (SIGTERM) 01:45:39.231352 --- ParallelTerminationStrategy: PID 8387 died... 01:45:39.250666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8387): Terminated: ok {rc=0} 01:45:39.295693 --- ParallelTerminationStrategy: PID 8388 died... 01:45:39.314420 run iperf3-srv_10.42.42.10(pid=8388): Terminated {rc=256} 01:45:39.358984 --- ParallelTerminationStrategy: PID 8389 died... 01:45:39.378030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8389): Terminated: ok {rc=0} 01:45:39.422547 --- ParallelTerminationStrategy: PID 8390 died... 01:45:39.441160 run iperf3-srv_10.42.42.10(pid=8390): Terminated {rc=256} 01:45:39.485559 --- ParallelTerminationStrategy: PID 8391 died... 01:45:39.504229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8391): Terminated: ok {rc=0} 01:45:39.548757 --- ParallelTerminationStrategy: PID 8392 died... 01:45:39.567377 run iperf3-srv_10.42.42.10(pid=8392): Terminated {rc=256} 01:45:39.611783 --- ParallelTerminationStrategy: PID 8393 died... 01:45:39.630631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8393): Terminated: ok {rc=0} 01:45:39.675203 --- ParallelTerminationStrategy: PID 8394 died... 01:45:39.693793 run iperf3-srv_10.42.42.10(pid=8394): Terminated {rc=256} 01:45:39.738074 --- ParallelTerminationStrategy: PID 8397 died... 01:45:39.756741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8397): Terminated: ok {rc=0} 01:45:39.801181 --- ParallelTerminationStrategy: PID 8400 died... 01:45:39.819857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8400): Terminated: ok {rc=0} 01:45:39.864787 --- ParallelTerminationStrategy: PID 8403 died... 01:45:39.883851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8403): Terminated: ok {rc=0} 01:45:39.968852 bus /gobi_4: Setting Powered False 01:45:41.065644 bus /gobi_4: Setting Powered False 01:45:42.177818 bus /gobi_1: Setting Powered False 01:45:43.276177 bus /gobi_1: Setting Powered False 01:45:44.392937 bus /gobi_0: Setting Powered False 01:45:45.491103 bus /gobi_0: Setting Powered False 01:45:46.624148 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 01:45:47.743329 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:47.755303 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:45:47.797392 tst ping.py: using LAC 18210 01:45:47.923177 tst ping.py: using RAC 105 01:45:48.047604 tst ping.py: using CellId 18210 01:45:48.171850 tst ping.py: using BVCI 18211 01:45:48.282140 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:48.293221 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:48.304178 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:48.315462 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:48.326532 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:48.337829 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:48.349360 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:48.360447 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:48.474263 tst ping.py:19: start network... 01:45:48.674065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:49.133435 run create_hlr_db(pid=8405): Launched 01:45:49.247701 bus /gobi_6: Setting Powered False 01:45:50.307053 run create_hlr_db(pid=8405): Terminated: ok {rc=0} 01:45:50.744737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8407): Launched 01:45:51.063218 run osmo-hlr_10.42.42.2(pid=8408): Launched 01:45:51.186894 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:51.739617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8410): Launched 01:45:52.059415 run osmo-stp_10.42.42.5(pid=8411): Launched 01:45:52.181968 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:52.738648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8413): Launched 01:45:52.862747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:53.133109 run patchelf(pid=8414): Launched 01:45:53.311204 run osmo-stp_10.42.42.5(pid=8411): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8411)] 01:45:53.446569 run osmo-stp_10.42.42.5(pid=8411): stdout: | (launched: 2022-12-09_01:45:52.000941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:53.584179 run osmo-stp_10.42.42.5(pid=8411): stderr: | 20221209014552191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014552191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014552191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014552192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014552192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014552192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014552192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:53.721371 run osmo-stp_10.42.42.5(pid=8411): stdout: | (launched: 2022-12-09_01:45:52.000941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:53.852258 run osmo-stp_10.42.42.5(pid=8411): stderr: | 20221209014552191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014552191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014552191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014552192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014552192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014552192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014552192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:54.007212 run patchelf(pid=8414): Terminating (SIGINT) 01:45:54.187093 run patchelf(pid=8414): Terminated: ok {rc=0} 01:45:54.316688 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8411): Process ended prematurely: osmo-stp_10.42.42.5(pid=8411) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8411)] [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 01:45:54.326345 tst ping.py:22: Test FAILED (6.6 sec) 01:45:54.354646 run osmo-hlr_10.42.42.2(pid=8408): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8408)] 01:45:54.404792 run osmo-hlr_10.42.42.2(pid=8408): stdout: | (launched: 2022-12-09_01:45:51.004857) 01:45:54.456891 run osmo-hlr_10.42.42.2(pid=8408): stderr: | 20221209014551203 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014551203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014551203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014551203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014551203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014551203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014551215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014551223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014551223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014551223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:54.509650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8407): Terminating (SIGTERM) 01:45:54.551861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8410): Terminating (SIGTERM) 01:45:54.594088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8413): Terminating (SIGTERM) 01:45:54.636514 --- ParallelTerminationStrategy: PID 8407 died... 01:45:54.656702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8407): Terminated: ok {rc=0} 01:45:54.703684 --- ParallelTerminationStrategy: PID 8410 died... 01:45:54.723488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8410): Terminated: ok {rc=0} 01:45:54.770035 --- ParallelTerminationStrategy: PID 8413 died... 01:45:54.789696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8413): Terminated: ok {rc=0} 01:45:54.877935 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:45:55.966675 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:55.979128 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:45:56.022350 tst ping_idle_ping.py: using LAC 18211 01:45:56.148867 tst ping_idle_ping.py: using RAC 106 01:45:56.274422 tst ping_idle_ping.py: using CellId 18211 01:45:56.401136 tst ping_idle_ping.py: using BVCI 18212 01:45:56.517905 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:56.529465 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:56.540728 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:56.552023 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:56.563264 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:56.574462 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:56.586000 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:56.597257 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:56.717808 tst ping_idle_ping.py:24: start network... 01:45:56.933784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:57.436160 run create_hlr_db(pid=8415): Launched 01:45:57.560739 bus /gobi_6: Setting Powered False 01:45:58.621364 run create_hlr_db(pid=8415): Terminated: ok {rc=0} 01:45:59.039724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8417): Launched 01:45:59.340628 run osmo-hlr_10.42.42.2(pid=8418): Launched 01:45:59.456063 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:59.987894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8420): Launched 01:46:00.288150 run osmo-stp_10.42.42.5(pid=8421): Launched 01:46:00.403365 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:00.957649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8423): Launched 01:46:01.108601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:01.416022 run patchelf(pid=8424): Launched 01:46:01.609252 run osmo-stp_10.42.42.5(pid=8421): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8421)] 01:46:01.748838 run osmo-stp_10.42.42.5(pid=8421): stdout: | (launched: 2022-12-09_01:46:00.233052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:01.890203 run osmo-stp_10.42.42.5(pid=8421): stderr: | 20221209014600403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014600403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014600403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014600404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014600404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014600404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014600404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:02.031222 run osmo-stp_10.42.42.5(pid=8421): stdout: | (launched: 2022-12-09_01:46:00.233052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:02.165109 run osmo-stp_10.42.42.5(pid=8421): stderr: | 20221209014600403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014600403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014600403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014600404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014600404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014600404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014600404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:02.321926 run patchelf(pid=8424): Terminating (SIGINT) 01:46:02.501603 run patchelf(pid=8424): Terminated: ok {rc=0} 01:46:02.631831 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8421): Process ended prematurely: osmo-stp_10.42.42.5(pid=8421) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8421)] [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 01:46:02.641512 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:46:02.669736 run osmo-hlr_10.42.42.2(pid=8418): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8418)] 01:46:02.720260 run osmo-hlr_10.42.42.2(pid=8418): stdout: | (launched: 2022-12-09_01:45:59.285071) 01:46:02.772289 run osmo-hlr_10.42.42.2(pid=8418): stderr: | 20221209014559459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014559459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014559459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014559459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014559459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014559459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014559471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014559479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014559480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014559480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:02.824524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8417): Terminating (SIGTERM) 01:46:02.866965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8420): Terminating (SIGTERM) 01:46:02.909098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8423): Terminating (SIGTERM) 01:46:02.951309 --- ParallelTerminationStrategy: PID 8417 died... 01:46:02.971465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8417): Terminated: ok {rc=0} 01:46:03.018121 --- ParallelTerminationStrategy: PID 8420 died... 01:46:03.037928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8420): Terminated: ok {rc=0} 01:46:03.084337 --- ParallelTerminationStrategy: PID 8423 died... 01:46:03.104433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8423): Terminated: ok {rc=0} 01:46:03.192540 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:46:04.481969 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:46:04.489365 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:46:04.514081 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:46:04.552569 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:46:04.641308 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:46:04.665463 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:46:04.703931 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:46:05.295174 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:46:05.344459 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:05.355477 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:46:05.414235 tst cs_paging_gprs_active.py: using LAC 18212 01:46:05.533571 tst cs_paging_gprs_active.py: using RAC 107 01:46:05.652784 tst cs_paging_gprs_active.py: using CellId 18212 01:46:05.771623 tst cs_paging_gprs_active.py: using BVCI 18213 01:46:05.891045 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:05.902725 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:05.914235 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:05.925891 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:05.937582 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:05.949289 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:05.960908 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:05.972519 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:05.984478 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:06.100451 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:06.220037 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:46:06.439976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:46:06.766180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8428): Launched 01:46:07.051400 run iperf3-srv_10.42.42.10(pid=8429): Launched 01:46:07.174473 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:46:07.394053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:46:07.721439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8430): Launched 01:46:08.004810 run iperf3-srv_10.42.42.10(pid=8431): Launched 01:46:08.127371 tst cs_paging_gprs_active.py:38: start network... 01:46:08.346462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:08.851646 run create_hlr_db(pid=8432): Launched 01:46:08.985406 bus /gobi_6: Setting Powered False 01:46:10.049808 run create_hlr_db(pid=8432): Terminated: ok {rc=0} 01:46:10.503583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8434): Launched 01:46:10.829095 run osmo-hlr_10.42.42.2(pid=8435): Launched 01:46:10.953425 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:11.517107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8437): Launched 01:46:11.843510 run osmo-stp_10.42.42.5(pid=8438): Launched 01:46:11.969406 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:12.531453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8440): Launched 01:46:12.658300 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:12.934132 run patchelf(pid=8441): Launched 01:46:13.117870 run osmo-stp_10.42.42.5(pid=8438): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8438)] 01:46:13.256529 run osmo-stp_10.42.42.5(pid=8438): stdout: | (launched: 2022-12-09_01:46:11.784194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:13.397021 run osmo-stp_10.42.42.5(pid=8438): stderr: | 20221209014611978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014611978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014611979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014611979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014611979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014611980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014611980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:13.537950 run osmo-stp_10.42.42.5(pid=8438): stdout: | (launched: 2022-12-09_01:46:11.784194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:13.671987 run osmo-stp_10.42.42.5(pid=8438): stderr: | 20221209014611978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014611978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014611979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014611979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014611979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014611980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014611980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:13.830736 run patchelf(pid=8441): Terminating (SIGINT) 01:46:14.014033 run patchelf(pid=8441): Terminated: ok {rc=0} 01:46:14.146685 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8438): Process ended prematurely: osmo-stp_10.42.42.5(pid=8438) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8438)] [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:46:14.156847 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:46:14.185946 run osmo-hlr_10.42.42.2(pid=8435): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8435)] 01:46:14.236315 run osmo-hlr_10.42.42.2(pid=8435): stdout: | (launched: 2022-12-09_01:46:10.769406) 01:46:14.288553 run osmo-hlr_10.42.42.2(pid=8435): stderr: | 20221209014610970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014610970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014610970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014610970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014610970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014610970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014610982 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014610992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014610992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014610993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:14.341444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8428): Terminating (SIGTERM) 01:46:14.383901 run iperf3-srv_10.42.42.10(pid=8429): Terminating (SIGTERM) 01:46:14.426316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8430): Terminating (SIGTERM) 01:46:14.468699 run iperf3-srv_10.42.42.10(pid=8431): Terminating (SIGTERM) 01:46:14.511041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8434): Terminating (SIGTERM) 01:46:14.553568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8437): Terminating (SIGTERM) 01:46:14.595983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8440): Terminating (SIGTERM) 01:46:14.638940 --- ParallelTerminationStrategy: PID 8428 died... 01:46:14.659332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8428): Terminated: ok {rc=0} 01:46:14.706860 --- ParallelTerminationStrategy: PID 8429 died... 01:46:14.726739 run iperf3-srv_10.42.42.10(pid=8429): Terminated {rc=256} 01:46:14.773302 --- ParallelTerminationStrategy: PID 8430 died... 01:46:14.792862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8430): Terminated: ok {rc=0} 01:46:14.839459 --- ParallelTerminationStrategy: PID 8431 died... 01:46:14.859201 run iperf3-srv_10.42.42.10(pid=8431): Terminated {rc=256} 01:46:14.905596 --- ParallelTerminationStrategy: PID 8434 died... 01:46:14.925370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8434): Terminated: ok {rc=0} 01:46:14.971554 --- ParallelTerminationStrategy: PID 8437 died... 01:46:14.991488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8437): Terminated: ok {rc=0} 01:46:15.038019 --- ParallelTerminationStrategy: PID 8440 died... 01:46:15.057933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8440): Terminated: ok {rc=0} 01:46:15.146811 bus /gobi_0: Setting Powered False 01:46:16.244431 bus /gobi_0: Setting Powered False 01:46:17.357767 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:46:18.506726 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:18.518927 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:46:18.587894 tst iperf3.py: using LAC 18213 01:46:18.715025 tst iperf3.py: using RAC 108 01:46:18.841773 tst iperf3.py: using CellId 18213 01:46:18.966996 tst iperf3.py: using BVCI 18214 01:46:19.084378 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:19.096362 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:19.107962 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:19.119489 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:19.130898 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:19.142385 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:19.153918 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:19.165266 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:19.176716 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:19.294851 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:46:19.513509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:46:19.840198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8442): Launched 01:46:20.123275 run iperf3-srv_10.42.42.10(pid=8443): Launched 01:46:20.246540 tst iperf3.py:8: start network... 01:46:20.465065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:20.967586 run create_hlr_db(pid=8444): Launched 01:46:21.100111 bus /gobi_6: Setting Powered False 01:46:22.164381 run create_hlr_db(pid=8444): Terminated: ok {rc=0} 01:46:22.596895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8446): Launched 01:46:22.900789 run osmo-hlr_10.42.42.2(pid=8447): Launched 01:46:23.016469 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:23.539506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8449): Launched 01:46:23.845668 run osmo-stp_10.42.42.5(pid=8450): Launched 01:46:23.962730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:24.489031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8452): Launched 01:46:24.605878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:24.863530 run patchelf(pid=8453): Launched 01:46:25.033562 run osmo-stp_10.42.42.5(pid=8450): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8450)] 01:46:25.163360 run osmo-stp_10.42.42.5(pid=8450): stdout: | (launched: 2022-12-09_01:46:23.789530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:25.294770 run osmo-stp_10.42.42.5(pid=8450): stderr: | 20221209014623961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014623962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014623962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014623962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014623963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014623963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014623963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:25.425933 run osmo-stp_10.42.42.5(pid=8450): stdout: | (launched: 2022-12-09_01:46:23.789530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:25.551249 run osmo-stp_10.42.42.5(pid=8450): stderr: | 20221209014623961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014623962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014623962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014623962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014623963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014623963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014623963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:25.699514 run patchelf(pid=8453): Terminating (SIGINT) 01:46:25.872196 run patchelf(pid=8453): Terminated: ok {rc=0} 01:46:25.996309 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8450): Process ended prematurely: osmo-stp_10.42.42.5(pid=8450) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8450)] [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 01:46:26.005954 tst iperf3.py:8: Test FAILED (7.5 sec) 01:46:26.033864 run osmo-hlr_10.42.42.2(pid=8447): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8447)] 01:46:26.082980 run osmo-hlr_10.42.42.2(pid=8447): stdout: | (launched: 2022-12-09_01:46:22.845114) 01:46:26.133421 run osmo-hlr_10.42.42.2(pid=8447): stderr: | 20221209014623021 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014623021 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014623021 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014623022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014623022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014623022 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014623034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014623042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014623042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014623042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:26.184473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8442): Terminating (SIGTERM) 01:46:26.225287 run iperf3-srv_10.42.42.10(pid=8443): Terminating (SIGTERM) 01:46:26.265695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8446): Terminating (SIGTERM) 01:46:26.306118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8449): Terminating (SIGTERM) 01:46:26.346416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8452): Terminating (SIGTERM) 01:46:26.387347 --- ParallelTerminationStrategy: PID 8442 died... 01:46:26.406714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8442): Terminated: ok {rc=0} 01:46:26.452108 --- ParallelTerminationStrategy: PID 8443 died... 01:46:26.470994 run iperf3-srv_10.42.42.10(pid=8443): Terminated {rc=256} 01:46:26.515771 --- ParallelTerminationStrategy: PID 8446 died... 01:46:26.534495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8446): Terminated: ok {rc=0} 01:46:26.578968 --- ParallelTerminationStrategy: PID 8449 died... 01:46:26.597791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8449): Terminated: ok {rc=0} 01:46:26.642084 --- ParallelTerminationStrategy: PID 8452 died... 01:46:26.660831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8452): Terminated: ok {rc=0} 01:46:26.745247 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:46:27.893681 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:27.906018 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:46:27.968564 tst iperf3m4.py: using LAC 18214 01:46:28.095325 tst iperf3m4.py: using RAC 109 01:46:28.229212 tst iperf3m4.py: using CellId 18214 01:46:28.355543 tst iperf3m4.py: using BVCI 18215 01:46:28.473129 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.484469 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.495820 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.507115 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.518351 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.529729 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.541100 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.552448 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.563915 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:28.682741 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:28.802396 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:28.922433 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:29.042194 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:46:29.261847 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:46:29.589800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8454): Launched 01:46:29.879331 run iperf3-srv_10.42.42.10(pid=8455): Launched 01:46:30.003368 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:46:30.222778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:46:30.549266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8456): Launched 01:46:30.834286 run iperf3-srv_10.42.42.10(pid=8457): Launched 01:46:30.979556 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:46:31.230959 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:46:31.569222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8458): Launched 01:46:31.861014 run iperf3-srv_10.42.42.10(pid=8459): Launched 01:46:31.998957 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:46:32.223042 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:46:32.549320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8460): Launched 01:46:32.832323 run iperf3-srv_10.42.42.10(pid=8461): Launched 01:46:32.954562 tst iperf3m4.py:8: start network... 01:46:33.174575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:33.678084 run create_hlr_db(pid=8462): Launched 01:46:33.811923 bus /gobi_6: Setting Powered False 01:46:34.875861 run create_hlr_db(pid=8462): Terminated: ok {rc=0} 01:46:35.309681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8464): Launched 01:46:35.615725 run osmo-hlr_10.42.42.2(pid=8465): Launched 01:46:35.733275 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:36.260069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8467): Launched 01:46:36.586352 run osmo-stp_10.42.42.5(pid=8468): Launched 01:46:36.711195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:37.272181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8470): Launched 01:46:37.398627 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:37.673552 run patchelf(pid=8471): Launched 01:46:37.856571 run osmo-stp_10.42.42.5(pid=8468): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8468)] 01:46:37.994838 run osmo-stp_10.42.42.5(pid=8468): stdout: | (launched: 2022-12-09_01:46:36.527366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:38.135527 run osmo-stp_10.42.42.5(pid=8468): stderr: | 20221209014636714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014636714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014636715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014636715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014636716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014636716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014636716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:38.275209 run osmo-stp_10.42.42.5(pid=8468): stdout: | (launched: 2022-12-09_01:46:36.527366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:38.408703 run osmo-stp_10.42.42.5(pid=8468): stderr: | 20221209014636714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014636714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014636715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014636715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014636716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014636716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014636716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:38.566698 run patchelf(pid=8471): Terminating (SIGINT) 01:46:38.749940 run patchelf(pid=8471): Terminated: ok {rc=0} 01:46:38.882094 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8468): Process ended prematurely: osmo-stp_10.42.42.5(pid=8468) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8468)] [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:46:38.892285 tst iperf3m4.py:8: Test FAILED (11.0 sec) 01:46:38.921329 run osmo-hlr_10.42.42.2(pid=8465): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8465)] 01:46:38.971353 run osmo-hlr_10.42.42.2(pid=8465): stdout: | (launched: 2022-12-09_01:46:35.559728) 01:46:39.023192 run osmo-hlr_10.42.42.2(pid=8465): stderr: | 20221209014635730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014635730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014635730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014635730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014635730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014635730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014635743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014635752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014635752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014635752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:39.075417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8454): Terminating (SIGTERM) 01:46:39.117839 run iperf3-srv_10.42.42.10(pid=8455): Terminating (SIGTERM) 01:46:39.159797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8456): Terminating (SIGTERM) 01:46:39.201873 run iperf3-srv_10.42.42.10(pid=8457): Terminating (SIGTERM) 01:46:39.243791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8458): Terminating (SIGTERM) 01:46:39.285791 run iperf3-srv_10.42.42.10(pid=8459): Terminating (SIGTERM) 01:46:39.327595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8460): Terminating (SIGTERM) 01:46:39.369572 run iperf3-srv_10.42.42.10(pid=8461): Terminating (SIGTERM) 01:46:39.411377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8464): Terminating (SIGTERM) 01:46:39.453507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8467): Terminating (SIGTERM) 01:46:39.495596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8470): Terminating (SIGTERM) 01:46:39.538612 --- ParallelTerminationStrategy: PID 8454 died... 01:46:39.559038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8454): Terminated: ok {rc=0} 01:46:39.606130 --- ParallelTerminationStrategy: PID 8455 died... 01:46:39.625855 run iperf3-srv_10.42.42.10(pid=8455): Terminated {rc=256} 01:46:39.672062 --- ParallelTerminationStrategy: PID 8456 died... 01:46:39.691786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8456): Terminated: ok {rc=0} 01:46:39.738132 --- ParallelTerminationStrategy: PID 8457 died... 01:46:39.757795 run iperf3-srv_10.42.42.10(pid=8457): Terminated {rc=256} 01:46:39.804176 --- ParallelTerminationStrategy: PID 8458 died... 01:46:39.823890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8458): Terminated: ok {rc=0} 01:46:39.870477 --- ParallelTerminationStrategy: PID 8459 died... 01:46:39.890222 run iperf3-srv_10.42.42.10(pid=8459): Terminated {rc=256} 01:46:39.936653 --- ParallelTerminationStrategy: PID 8460 died... 01:46:39.956474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8460): Terminated: ok {rc=0} 01:46:40.002860 --- ParallelTerminationStrategy: PID 8461 died... 01:46:40.022523 run iperf3-srv_10.42.42.10(pid=8461): Terminated {rc=256} 01:46:40.069115 --- ParallelTerminationStrategy: PID 8464 died... 01:46:40.088823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8464): Terminated: ok {rc=0} 01:46:40.135332 --- ParallelTerminationStrategy: PID 8467 died... 01:46:40.155176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8467): Terminated: ok {rc=0} 01:46:40.201449 --- ParallelTerminationStrategy: PID 8470 died... 01:46:40.221412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8470): Terminated: ok {rc=0} 01:46:40.311412 bus /gobi_4: Setting Powered False 01:46:41.413364 bus /gobi_4: Setting Powered False 01:46:42.532800 bus /gobi_1: Setting Powered False 01:46:43.634145 bus /gobi_1: Setting Powered False 01:46:44.750981 bus /gobi_0: Setting Powered False 01:46:45.852403 bus /gobi_0: Setting Powered False 01:46:46.977021 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:46:48.079618 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:48.091473 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:46:48.153434 tst ping.py: using LAC 18215 01:46:48.285569 tst ping.py: using RAC 110 01:46:48.418214 tst ping.py: using CellId 18215 01:46:48.545350 tst ping.py: using BVCI 18216 01:46:48.663731 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:48.675545 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:48.687018 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:48.698955 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:48.710629 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:48.722426 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:48.734347 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:48.746118 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:48.867114 tst ping.py:19: start network... 01:46:49.083942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:49.581184 run create_hlr_db(pid=8472): Launched 01:46:49.713340 bus /gobi_6: Setting Powered False 01:46:50.777671 run create_hlr_db(pid=8472): Terminated: ok {rc=0} 01:46:51.206464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8474): Launched 01:46:51.506010 run osmo-hlr_10.42.42.2(pid=8475): Launched 01:46:51.621876 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:52.158888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8477): Launched 01:46:52.457047 run osmo-stp_10.42.42.5(pid=8478): Launched 01:46:52.571833 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:53.088697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8480): Launched 01:46:53.203984 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:53.456123 run patchelf(pid=8481): Launched 01:46:53.622848 run osmo-stp_10.42.42.5(pid=8478): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8478)] 01:46:53.749340 run osmo-stp_10.42.42.5(pid=8478): stdout: | (launched: 2022-12-09_01:46:52.401803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:53.877744 run osmo-stp_10.42.42.5(pid=8478): stderr: | 20221209014652571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014652571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014652571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014652572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014652572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014652572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014652572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:54.006406 run osmo-stp_10.42.42.5(pid=8478): stdout: | (launched: 2022-12-09_01:46:52.401803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:54.128436 run osmo-stp_10.42.42.5(pid=8478): stderr: | 20221209014652571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014652571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014652571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014652572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014652572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014652572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014652572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:54.273162 run patchelf(pid=8481): Terminating (SIGINT) 01:46:54.440742 run patchelf(pid=8481): Terminated: ok {rc=0} 01:46:54.562021 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8478): Process ended prematurely: osmo-stp_10.42.42.5(pid=8478) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8478)] [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 01:46:54.570936 tst ping.py:22: Test FAILED (6.5 sec) 01:46:54.598570 run osmo-hlr_10.42.42.2(pid=8475): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8475)] 01:46:54.646913 run osmo-hlr_10.42.42.2(pid=8475): stdout: | (launched: 2022-12-09_01:46:51.451053) 01:46:54.696925 run osmo-hlr_10.42.42.2(pid=8475): stderr: | 20221209014651627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014651627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014651627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014651627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014651627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014651627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014651640 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014651650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014651650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014651651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:54.747349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8474): Terminating (SIGTERM) 01:46:54.787477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8477): Terminating (SIGTERM) 01:46:54.827670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8480): Terminating (SIGTERM) 01:46:54.867596 --- ParallelTerminationStrategy: PID 8474 died... 01:46:54.887058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8474): Terminated: ok {rc=0} 01:46:54.931918 --- ParallelTerminationStrategy: PID 8477 died... 01:46:54.950828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8477): Terminated: ok {rc=0} 01:46:54.995439 --- ParallelTerminationStrategy: PID 8480 died... 01:46:55.014201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8480): Terminated: ok {rc=0} 01:46:55.098583 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:46:56.183591 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:56.195333 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:46:56.257421 tst ping_idle_ping.py: using LAC 18216 01:46:56.375149 tst ping_idle_ping.py: using RAC 111 01:46:56.494251 tst ping_idle_ping.py: using CellId 18216 01:46:56.613953 tst ping_idle_ping.py: using BVCI 18217 01:46:56.723567 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:56.734729 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:56.745770 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:56.757427 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:56.768643 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:56.779964 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:56.791244 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:56.802683 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:56.919583 tst ping_idle_ping.py:24: start network... 01:46:57.120606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:57.582989 run create_hlr_db(pid=8482): Launched 01:46:57.696808 bus /gobi_6: Setting Powered False 01:46:58.757476 run create_hlr_db(pid=8482): Terminated: ok {rc=0} 01:46:59.174844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8484): Launched 01:46:59.475045 run osmo-hlr_10.42.42.2(pid=8485): Launched 01:46:59.589327 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:00.104290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8487): Launched 01:47:00.402282 run osmo-stp_10.42.42.5(pid=8488): Launched 01:47:00.516605 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:47:01.073664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8490): Launched 01:47:01.204019 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:47:01.509279 run patchelf(pid=8491): Launched 01:47:01.704861 run osmo-stp_10.42.42.5(pid=8488): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8488)] 01:47:01.846763 run osmo-stp_10.42.42.5(pid=8488): stdout: | (launched: 2022-12-09_01:47:00.347585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:01.990017 run osmo-stp_10.42.42.5(pid=8488): stderr: | 20221209014700512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014700513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014700513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014700513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014700514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014700514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014700514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:02.150032 run osmo-stp_10.42.42.5(pid=8488): stdout: | (launched: 2022-12-09_01:47:00.347585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:02.276000 run osmo-stp_10.42.42.5(pid=8488): stderr: | 20221209014700512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014700513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014700513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014700513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014700514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014700514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014700514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:02.421700 run patchelf(pid=8491): Terminating (SIGINT) 01:47:02.590613 run patchelf(pid=8491): Terminated: ok {rc=0} 01:47:02.712590 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8488): Process ended prematurely: osmo-stp_10.42.42.5(pid=8488) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8488)] [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:47:02.721938 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:47:02.749521 run osmo-hlr_10.42.42.2(pid=8485): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8485)] 01:47:02.798065 run osmo-hlr_10.42.42.2(pid=8485): stdout: | (launched: 2022-12-09_01:46:59.420114) 01:47:02.848051 run osmo-hlr_10.42.42.2(pid=8485): stderr: | 20221209014659597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014659597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014659597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014659597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014659597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014659597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014659609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014659618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014659618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014659618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:02.898474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8484): Terminating (SIGTERM) 01:47:02.938748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8487): Terminating (SIGTERM) 01:47:02.978857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8490): Terminating (SIGTERM) 01:47:03.019308 --- ParallelTerminationStrategy: PID 8484 died... 01:47:03.038442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8484): Terminated: ok {rc=0} 01:47:03.083236 --- ParallelTerminationStrategy: PID 8487 died... 01:47:03.102027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8487): Terminated: ok {rc=0} 01:47:03.146902 --- ParallelTerminationStrategy: PID 8490 died... 01:47:03.165713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8490): Terminated: ok {rc=0} 01:47:03.252104 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 01:47:04.551646 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:04.559746 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:47:04.584363 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:47:04.620314 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:47:04.676241 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:47:04.700901 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:47:04.736780 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:47:05.296856 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:47:05.303396 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:47:05.315474 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:47:05.376559 tst switch_tch_pdch.py: using LAC 18217 01:47:05.492816 tst switch_tch_pdch.py: using RAC 112 01:47:05.608520 tst switch_tch_pdch.py: using CellId 18217 01:47:05.725163 tst switch_tch_pdch.py: using BVCI 18218 01:47:05.841664 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:47:05.853711 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:47:05.865554 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:47:05.877833 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:47:05.889773 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:47:05.901607 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:47:05.913727 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:47:05.925788 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:47:06.041614 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:47:06.162580 tst switch_tch_pdch.py:51: start network... 01:47:06.362613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:06.822057 run create_hlr_db(pid=8496): Launched 01:47:06.936460 bus /gobi_6: Setting Powered False 01:47:08.000064 run create_hlr_db(pid=8496): Terminated: ok {rc=0} 01:47:08.446178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8498): Launched 01:47:08.767927 run osmo-hlr_10.42.42.2(pid=8499): Launched 01:47:08.890588 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:09.440922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8501): Launched 01:47:09.759309 run osmo-stp_10.42.42.5(pid=8502): Launched 01:47:09.882245 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:47:10.435405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8504): Launched 01:47:10.557647 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:47:10.827246 run patchelf(pid=8505): Launched 01:47:11.006807 run osmo-stp_10.42.42.5(pid=8502): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8502)] 01:47:11.142773 run osmo-stp_10.42.42.5(pid=8502): stdout: | (launched: 2022-12-09_01:47:09.701181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:11.279724 run osmo-stp_10.42.42.5(pid=8502): stderr: | 20221209014709892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014709892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014709892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014709893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014709893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014709893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014709893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:11.417097 run osmo-stp_10.42.42.5(pid=8502): stdout: | (launched: 2022-12-09_01:47:09.701181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:11.547777 run osmo-stp_10.42.42.5(pid=8502): stderr: | 20221209014709892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014709892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014709892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014709893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014709893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014709893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014709893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:11.703283 run patchelf(pid=8505): Terminating (SIGINT) 01:47:11.882165 run patchelf(pid=8505): Terminated: ok {rc=0} 01:47:12.010991 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8502): Process ended prematurely: osmo-stp_10.42.42.5(pid=8502) [trial-2352↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8502)] [trial-2352↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:47:12.020603 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 01:47:12.048653 run osmo-hlr_10.42.42.2(pid=8499): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8499)] 01:47:12.098752 run osmo-hlr_10.42.42.2(pid=8499): stdout: | (launched: 2022-12-09_01:47:08.709785) 01:47:12.151511 run osmo-hlr_10.42.42.2(pid=8499): stderr: | 20221209014708906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014708906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014708906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014708906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014708906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014708907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014708919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014708927 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014708927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014708928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:12.204098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8498): Terminating (SIGTERM) 01:47:12.246348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8501): Terminating (SIGTERM) 01:47:12.288457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8504): Terminating (SIGTERM) 01:47:12.331043 --- ParallelTerminationStrategy: PID 8498 died... 01:47:12.351280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8498): Terminated: ok {rc=0} 01:47:12.398290 --- ParallelTerminationStrategy: PID 8501 died... 01:47:12.418193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8501): Terminated: ok {rc=0} 01:47:12.464726 --- ParallelTerminationStrategy: PID 8504 died... 01:47:12.484495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8504): Terminated: ok {rc=0} 01:47:12.572544 bus /gobi_0: Setting Powered False 01:47:13.672127 bus /gobi_0: Setting Powered False 01:47:14.788083 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 sms:nanobts+band-900 --------------------------------------------------------------------- 01:47:16.064297 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:16.070204 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:47:16.118523 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 01:47:16.155314 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 01:47:16.222768 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:47:16.267410 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 01:47:16.305836 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 01:47:16.847123 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 01:47:16.853760 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:16.865362 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 01:47:16.915696 tst mo_mt_sms.py: using LAC 18218 01:47:17.074928 tst mo_mt_sms.py: using RAC 113 01:47:17.205725 tst mo_mt_sms.py: using CellId 18218 01:47:17.332531 tst mo_mt_sms.py: using BVCI 18219 01:47:17.451404 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:17.462720 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:17.473906 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:17.485015 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:17.496183 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:17.507363 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 01:47:17.621574 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 01:47:17.738810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:18.233361 run create_hlr_db(pid=8510): Launched 01:47:18.364936 bus /gobi_6: Setting Powered False 01:47:19.428551 run create_hlr_db(pid=8510): Terminated: ok {rc=0} 01:47:19.856732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8512): Launched 01:47:20.156294 run osmo-hlr_10.42.42.2(pid=8513): Launched 01:47:20.271509 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:20.784375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8515): Launched 01:47:21.082640 run osmo-stp_10.42.42.5(pid=8516): Launched 01:47:21.196595 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:21.734999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8518): Launched 01:47:22.034853 run osmo-msc_10.42.42.6(pid=8519): Launched 01:47:22.203658 run osmo-stp_10.42.42.5(pid=8516): ERR: Terminated: ERROR {rc=1} [trial-2352↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8516)] 01:47:22.330412 run osmo-stp_10.42.42.5(pid=8516): stdout: | (launched: 2022-12-09_01:47:21.027768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:22.457233 run osmo-stp_10.42.42.5(pid=8516): stderr: | 20221209014721196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014721196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014721197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014721197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014721197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014721197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014721198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:22.581674 run osmo-stp_10.42.42.5(pid=8516): stdout: | (launched: 2022-12-09_01:47:21.027768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:22.700038 run osmo-stp_10.42.42.5(pid=8516): stderr: | 20221209014721196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014721196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014721197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014721197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014721197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014721197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014721198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:22.842242 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8516): Process ended prematurely: osmo-stp_10.42.42.5(pid=8516) [trial-2352↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8516)] [trial-2352↪sms:nanobts+band-900↪mo_mt_sms.py:16] 01:47:22.850547 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 01:47:22.877023 run osmo-hlr_10.42.42.2(pid=8513): ERR: Terminated: ERROR {rc=237} [trial-2352↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8513)] 01:47:22.925066 run osmo-hlr_10.42.42.2(pid=8513): stdout: | (launched: 2022-12-09_01:47:20.101153) 01:47:22.975663 run osmo-hlr_10.42.42.2(pid=8513): stderr: | 20221209014720277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014720277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014720277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014720277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014720277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014720278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014720290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014720298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014720299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014720299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:23.044869 run osmo-msc_10.42.42.6(pid=8519): ERR: Terminated: ERROR {rc=2} [trial-2352↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8519)] 01:47:23.092854 run osmo-msc_10.42.42.6(pid=8519): stdout: | (launched: 2022-12-09_01:47:21.979902) 01:47:23.142291 run osmo-msc_10.42.42.6(pid=8519): stderr: | 20221209014722251 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014722251 DLGLOBAL DEBUG validating counter group 0x7f5b4f344c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014722251 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014722251 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014722251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014722252 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014722253 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014722254 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014722255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014722255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:23.192174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8512): Terminating (SIGTERM) 01:47:23.231958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8515): Terminating (SIGTERM) 01:47:23.271892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8518): Terminating (SIGTERM) 01:47:23.312208 --- ParallelTerminationStrategy: PID 8512 died... 01:47:23.331272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8512): Terminated: ok {rc=0} 01:47:23.376091 --- ParallelTerminationStrategy: PID 8515 died... 01:47:23.394840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8515): Terminated: ok {rc=0} 01:47:23.438995 --- ParallelTerminationStrategy: PID 8518 died... 01:47:23.457613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8518): Terminated: ok {rc=0} 01:47:23.543412 bus /sierra_3: Setting Powered False 01:47:24.643851 bus /sierra_3: Setting Powered False 01:47:25.761567 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 01:47:26.995556 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:27.000300 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:47:27.032833 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 01:47:27.039636 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 01:47:27.075197 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:47:27.107107 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 01:47:27.113957 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 01:47:27.633754 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2352 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 01:47:27.638979 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 01:47:27.650175 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 01:47:27.696680 tst assert_extension.py: using LAC 18219 01:47:27.814983 tst assert_extension.py: using RAC 114 01:47:27.934782 tst assert_extension.py: using CellId 18219 01:47:28.053224 tst assert_extension.py: using BVCI 18220 01:47:28.161165 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 01:47:28.278716 tst assert_extension.py:10: start nitb and bts... 01:47:28.494609 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:47:29.145907 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8524): Launched 01:47:29.467998 run osmo-nitb_10.42.42.2(pid=8525): Launched 01:47:29.644621 run osmo-nitb_10.42.42.2(pid=8525): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8525)] 01:47:29.787651 run osmo-nitb_10.42.42.2(pid=8525): stdout: | (launched: 2022-12-09_01:47:29.409701) 01:47:29.932427 run osmo-nitb_10.42.42.2(pid=8525): stderr: | (launched: 2022-12-09_01:47:29.457450) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:47:30.076939 run osmo-nitb_10.42.42.2(pid=8525): stdout: | (launched: 2022-12-09_01:47:29.409701) 01:47:30.215749 run osmo-nitb_10.42.42.2(pid=8525): stderr: | (launched: 2022-12-09_01:47:29.457450) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8525): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8525) [trial-2352↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8525)] 01:47:30.588754 tst osmo-nitb_10.42.42.2(pid=8525): stdout: | (launched: 2022-12-09_01:47:29.409701) 01:47:30.717477 tst osmo-nitb_10.42.42.2(pid=8525): stderr: | (launched: 2022-12-09_01:47:29.457450) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:47:30.870144 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8525): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8525) [trial-2352↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8525)] [trial-2352↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 01:47:30.879674 tst assert_extension.py:12: Test FAILED (3.2 sec) 01:47:30.887362 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8524): Terminating (SIGTERM) 01:47:31.099015 --- ParallelTerminationStrategy: PID 8524 died... 01:47:31.118300 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8524): Terminated: ok {rc=0} 01:47:31.206187 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 ussd:nanobts+band-900 --------------------------------------------------------------------- 01:47:32.378997 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:32.383707 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:47:32.416582 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 01:47:32.443089 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 01:47:32.477926 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:47:32.509537 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 01:47:32.535524 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 01:47:33.065471 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2352 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 01:47:33.070353 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:33.080941 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 01:47:33.127197 tst assert_extension.py: using LAC 18220 01:47:33.243515 tst assert_extension.py: using RAC 115 01:47:33.362379 tst assert_extension.py: using CellId 18220 01:47:33.484732 tst assert_extension.py: using BVCI 18221 01:47:33.594378 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:33.605073 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:33.615526 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:33.626230 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:33.636937 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:33.647661 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 01:47:33.764735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:34.259038 run create_hlr_db(pid=8530): Launched 01:47:34.391811 bus /sierra_2: Setting Powered False 01:47:35.454498 run create_hlr_db(pid=8530): Terminated: ok {rc=0} 01:47:35.895561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8533): Launched 01:47:36.215269 run osmo-hlr_10.42.42.2(pid=8534): Launched 01:47:36.337762 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:36.893178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8536): Launched 01:47:37.212855 run osmo-stp_10.42.42.5(pid=8537): Launched 01:47:37.335953 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:37.911348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8539): Launched 01:47:38.229651 run osmo-msc_10.42.42.6(pid=8540): Launched 01:47:38.409818 run osmo-stp_10.42.42.5(pid=8537): ERR: Terminated: ERROR {rc=1} [trial-2352↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8537)] 01:47:38.543415 run osmo-stp_10.42.42.5(pid=8537): stdout: | (launched: 2022-12-09_01:47:37.154287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:38.678918 run osmo-stp_10.42.42.5(pid=8537): stderr: | 20221209014737347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014737347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014737347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014737348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014737348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014737348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014737348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:38.812680 run osmo-stp_10.42.42.5(pid=8537): stdout: | (launched: 2022-12-09_01:47:37.154287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:38.939675 run osmo-stp_10.42.42.5(pid=8537): stderr: | 20221209014737347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014737347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014737347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014737348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014737348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014737348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014737348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:39.091465 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8537): Process ended prematurely: osmo-stp_10.42.42.5(pid=8537) [trial-2352↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8537)] [trial-2352↪ussd:nanobts+band-900↪assert_extension.py:17] 01:47:39.100454 tst assert_extension.py:17: Test FAILED (6.0 sec) 01:47:39.127948 run osmo-hlr_10.42.42.2(pid=8534): ERR: Terminated: ERROR {rc=237} [trial-2352↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8534)] 01:47:39.178429 run osmo-hlr_10.42.42.2(pid=8534): stdout: | (launched: 2022-12-09_01:47:36.156936) 01:47:39.231303 run osmo-hlr_10.42.42.2(pid=8534): stderr: | 20221209014736355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014736355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014736355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014736355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014736355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014736355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014736367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014736375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014736375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014736376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:39.303703 run osmo-msc_10.42.42.6(pid=8540): ERR: Terminated: ERROR {rc=2} [trial-2352↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8540)] 01:47:39.353961 run osmo-msc_10.42.42.6(pid=8540): stdout: | (launched: 2022-12-09_01:47:38.171361) 01:47:39.405854 run osmo-msc_10.42.42.6(pid=8540): stderr: | 20221209014738492 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014738492 DLGLOBAL DEBUG validating counter group 0x7f22cdb43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014738492 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014738492 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014738492 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014738493 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014738494 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014738495 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014738495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014738495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:39.458291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8533): Terminating (SIGTERM) 01:47:39.500132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8536): Terminating (SIGTERM) 01:47:39.542130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8539): Terminating (SIGTERM) 01:47:39.584301 --- ParallelTerminationStrategy: PID 8533 died... 01:47:39.603988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8533): Terminated: ok {rc=0} 01:47:39.650214 --- ParallelTerminationStrategy: PID 8536 died... 01:47:39.669869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8536): Terminated: ok {rc=0} 01:47:39.715890 --- ParallelTerminationStrategy: PID 8539 died... 01:47:39.735480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8539): Terminated: ok {rc=0} 01:47:39.823276 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:47:41.036113 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:41.044682 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:47:41.078371 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:47:41.105920 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:47:41.158769 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:47:41.191901 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:47:41.218997 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:47:41.769626 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:47:41.821307 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:41.832571 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:47:41.900312 tst mo_mt_call.py: using LAC 18221 01:47:42.021525 tst mo_mt_call.py: using RAC 116 01:47:42.143092 tst mo_mt_call.py: using CellId 18221 01:47:42.267240 tst mo_mt_call.py: using BVCI 18222 01:47:42.378617 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:42.390081 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:42.401194 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:42.413137 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:42.424840 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:42.436689 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:47:42.552220 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:47:42.672296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:43.148472 run create_hlr_db(pid=8545): Launched 01:47:43.265348 bus /sierra_2: Setting Powered False 01:47:44.326656 run create_hlr_db(pid=8545): Terminated: ok {rc=0} 01:47:44.772331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8547): Launched 01:47:45.097575 run osmo-hlr_10.42.42.2(pid=8548): Launched 01:47:45.225147 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:45.786618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8550): Launched 01:47:46.136662 run osmo-stp_10.42.42.5(pid=8551): Launched 01:47:46.497406 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:47.138466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8553): Launched 01:47:47.461526 run osmo-msc_10.42.42.6(pid=8554): Launched 01:47:47.635927 run osmo-stp_10.42.42.5(pid=8551): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8551)] 01:47:47.767369 run osmo-stp_10.42.42.5(pid=8551): stdout: | (launched: 2022-12-09_01:47:46.077484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:47.896189 run osmo-stp_10.42.42.5(pid=8551): stderr: | 20221209014746309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014746309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014746310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014746310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014746311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014746311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014746311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:48.022978 run osmo-stp_10.42.42.5(pid=8551): stdout: | (launched: 2022-12-09_01:47:46.077484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:48.143704 run osmo-stp_10.42.42.5(pid=8551): stderr: | 20221209014746309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014746309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014746310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014746310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014746311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014746311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014746311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:48.288453 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8551): Process ended prematurely: osmo-stp_10.42.42.5(pid=8551) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8551)] [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:47:48.297729 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 01:47:48.325040 run osmo-hlr_10.42.42.2(pid=8548): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8548)] 01:47:48.373653 run osmo-hlr_10.42.42.2(pid=8548): stdout: | (launched: 2022-12-09_01:47:45.038226) 01:47:48.424203 run osmo-hlr_10.42.42.2(pid=8548): stderr: | 20221209014745237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014745237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014745237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014745237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014745237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014745237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014745250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014745258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014745259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014745259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:48.494069 run osmo-msc_10.42.42.6(pid=8554): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8554)] 01:47:48.542097 run osmo-msc_10.42.42.6(pid=8554): stdout: | (launched: 2022-12-09_01:47:47.404850) 01:47:48.592133 run osmo-msc_10.42.42.6(pid=8554): stderr: | 20221209014747674 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014747674 DLGLOBAL DEBUG validating counter group 0x7f99eff1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014747674 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014747674 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014747674 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014747674 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014747676 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014747676 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014747677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014747677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:48.642488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8547): Terminating (SIGTERM) 01:47:48.682933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8550): Terminating (SIGTERM) 01:47:48.723703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8553): Terminating (SIGTERM) 01:47:48.764520 --- ParallelTerminationStrategy: PID 8547 died... 01:47:48.783899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8547): Terminated: ok {rc=0} 01:47:48.829311 --- ParallelTerminationStrategy: PID 8550 died... 01:47:48.848069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8550): Terminated: ok {rc=0} 01:47:48.893341 --- ParallelTerminationStrategy: PID 8553 died... 01:47:48.912100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8553): Terminated: ok {rc=0} 01:47:48.998893 bus /sierra_3: Setting Powered False 01:47:50.099374 bus /sierra_3: Setting Powered False 01:47:51.216229 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:47:52.367208 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:52.379630 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:47:52.448196 tst mo_mt_call_osmux.py: using LAC 18222 01:47:52.575733 tst mo_mt_call_osmux.py: using RAC 117 01:47:52.703248 tst mo_mt_call_osmux.py: using CellId 18222 01:47:52.830566 tst mo_mt_call_osmux.py: using BVCI 18223 01:47:52.948528 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:52.960563 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:52.972065 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:52.983611 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:52.995197 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:53.006800 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:47:53.125789 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:47:53.241703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:53.714601 run create_hlr_db(pid=8556): Launched 01:47:53.835224 bus /sierra_2: Setting Powered False 01:47:54.895394 run create_hlr_db(pid=8556): Terminated: ok {rc=0} 01:47:55.340709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8558): Launched 01:47:55.667044 run osmo-hlr_10.42.42.2(pid=8559): Launched 01:47:55.791675 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:56.358748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8561): Launched 01:47:56.686146 run osmo-stp_10.42.42.5(pid=8562): Launched 01:47:56.810050 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:57.398509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8564): Launched 01:47:57.724516 run osmo-msc_10.42.42.6(pid=8565): Launched 01:47:57.908217 run osmo-stp_10.42.42.5(pid=8562): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8562)] 01:47:58.046768 run osmo-stp_10.42.42.5(pid=8562): stdout: | (launched: 2022-12-09_01:47:56.626243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:58.184663 run osmo-stp_10.42.42.5(pid=8562): stderr: | 20221209014756819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014756819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014756820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014756820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014756821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014756821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014756821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:58.321208 run osmo-stp_10.42.42.5(pid=8562): stdout: | (launched: 2022-12-09_01:47:56.626243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:58.450723 run osmo-stp_10.42.42.5(pid=8562): stderr: | 20221209014756819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014756819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014756820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014756820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014756821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014756821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014756821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:58.606437 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8562): Process ended prematurely: osmo-stp_10.42.42.5(pid=8562) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8562)] [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:47:58.616033 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:47:58.644119 run osmo-hlr_10.42.42.2(pid=8559): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8559)] 01:47:58.694316 run osmo-hlr_10.42.42.2(pid=8559): stdout: | (launched: 2022-12-09_01:47:55.607535) 01:47:58.746153 run osmo-hlr_10.42.42.2(pid=8559): stderr: | 20221209014755807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014755807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014755807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014755807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014755807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014755807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014755820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014755829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014755829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014755829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:58.818503 run osmo-msc_10.42.42.6(pid=8565): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8565)] 01:47:58.868393 run osmo-msc_10.42.42.6(pid=8565): stdout: | (launched: 2022-12-09_01:47:57.664919) 01:47:58.920083 run osmo-msc_10.42.42.6(pid=8565): stderr: | 20221209014757987 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014757987 DLGLOBAL DEBUG validating counter group 0x7fe323858c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014757988 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014757988 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014757988 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014757988 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014757990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014757990 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014757990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014757990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:58.971995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8558): Terminating (SIGTERM) 01:47:59.013745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8561): Terminating (SIGTERM) 01:47:59.055981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8564): Terminating (SIGTERM) 01:47:59.098251 --- ParallelTerminationStrategy: PID 8558 died... 01:47:59.117981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8558): Terminated: ok {rc=0} 01:47:59.164681 --- ParallelTerminationStrategy: PID 8561 died... 01:47:59.184332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8561): Terminated: ok {rc=0} 01:47:59.230540 --- ParallelTerminationStrategy: PID 8564 died... 01:47:59.250075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8564): Terminated: ok {rc=0} 01:47:59.338377 bus /sierra_3: Setting Powered False 01:48:00.438041 bus /sierra_3: Setting Powered False 01:48:01.552170 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:48:02.803187 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:48:02.810482 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:48:02.843429 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:48:02.870131 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:48:02.923690 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:48:02.956568 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:48:02.983163 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:48:03.530872 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:48:03.581230 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:03.592637 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:48:03.664171 tst mo_mt_call.py: using LAC 18223 01:48:03.796179 tst mo_mt_call.py: using RAC 118 01:48:03.926273 tst mo_mt_call.py: using CellId 18223 01:48:04.045207 tst mo_mt_call.py: using BVCI 18224 01:48:04.155118 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:04.166421 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:04.177459 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:04.188717 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:04.200023 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:04.211228 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:48:04.329289 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:48:04.450823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:04.921470 run create_hlr_db(pid=8570): Launched 01:48:05.037345 bus /sierra_2: Setting Powered False 01:48:06.098366 run create_hlr_db(pid=8570): Terminated: ok {rc=0} 01:48:06.519844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8572): Launched 01:48:06.823521 run osmo-hlr_10.42.42.2(pid=8573): Launched 01:48:06.940322 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:07.473422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8575): Launched 01:48:07.778514 run osmo-stp_10.42.42.5(pid=8576): Launched 01:48:07.895203 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:08.443155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8578): Launched 01:48:08.748280 run osmo-msc_10.42.42.6(pid=8579): Launched 01:48:08.918364 run osmo-stp_10.42.42.5(pid=8576): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8576)] 01:48:09.046957 run osmo-stp_10.42.42.5(pid=8576): stdout: | (launched: 2022-12-09_01:48:07.722491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:09.175009 run osmo-stp_10.42.42.5(pid=8576): stderr: | 20221209014807889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014807889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014807889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014807890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014807890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014807890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014807891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:09.301175 run osmo-stp_10.42.42.5(pid=8576): stdout: | (launched: 2022-12-09_01:48:07.722491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:09.421570 run osmo-stp_10.42.42.5(pid=8576): stderr: | 20221209014807889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014807889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014807889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014807890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014807890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014807890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014807891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:09.565424 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8576): Process ended prematurely: osmo-stp_10.42.42.5(pid=8576) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8576)] [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:48:09.574285 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:48:09.601092 run osmo-hlr_10.42.42.2(pid=8573): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8573)] 01:48:09.649063 run osmo-hlr_10.42.42.2(pid=8573): stdout: | (launched: 2022-12-09_01:48:06.768078) 01:48:09.698576 run osmo-hlr_10.42.42.2(pid=8573): stderr: | 20221209014806942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014806942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014806942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014806942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014806942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014806942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014806954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014806963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014806963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014806963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:09.767791 run osmo-msc_10.42.42.6(pid=8579): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8579)] 01:48:09.815566 run osmo-msc_10.42.42.6(pid=8579): stdout: | (launched: 2022-12-09_01:48:08.691098) 01:48:09.864884 run osmo-msc_10.42.42.6(pid=8579): stderr: | 20221209014808964 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014808964 DLGLOBAL DEBUG validating counter group 0x7fb9b5aecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014808964 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014808964 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014808964 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014808964 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014808966 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014808967 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014808967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014808967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:09.914540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8572): Terminating (SIGTERM) 01:48:09.954281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8575): Terminating (SIGTERM) 01:48:09.993921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8578): Terminating (SIGTERM) 01:48:10.033970 --- ParallelTerminationStrategy: PID 8572 died... 01:48:10.053106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8572): Terminated: ok {rc=0} 01:48:10.097715 --- ParallelTerminationStrategy: PID 8575 died... 01:48:10.116168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8575): Terminated: ok {rc=0} 01:48:10.160669 --- ParallelTerminationStrategy: PID 8578 died... 01:48:10.179183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8578): Terminated: ok {rc=0} 01:48:10.266825 bus /sierra_3: Setting Powered False 01:48:11.365743 bus /sierra_3: Setting Powered False 01:48:12.479430 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:48:13.621787 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:13.633569 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:48:13.704227 tst mo_mt_call_osmux.py: using LAC 18224 01:48:13.823809 tst mo_mt_call_osmux.py: using RAC 119 01:48:13.941661 tst mo_mt_call_osmux.py: using CellId 18224 01:48:14.060790 tst mo_mt_call_osmux.py: using BVCI 18225 01:48:14.171300 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:14.182499 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:14.193413 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:14.204722 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:14.215760 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:48:14.227076 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:48:14.347679 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:48:14.466537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:14.973054 run create_hlr_db(pid=8582): Launched 01:48:15.108043 bus /sierra_2: Setting Powered False 01:48:16.171257 run create_hlr_db(pid=8582): Terminated: ok {rc=0} 01:48:16.631468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8584): Launched 01:48:16.972499 run osmo-hlr_10.42.42.2(pid=8585): Launched 01:48:17.191554 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:17.719983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8587): Launched 01:48:18.024620 run osmo-stp_10.42.42.5(pid=8588): Launched 01:48:18.140363 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:18.691213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8590): Launched 01:48:18.996245 run osmo-msc_10.42.42.6(pid=8591): Launched 01:48:19.170641 run osmo-stp_10.42.42.5(pid=8588): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8588)] 01:48:19.299928 run osmo-stp_10.42.42.5(pid=8588): stdout: | (launched: 2022-12-09_01:48:17.968399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:19.428786 run osmo-stp_10.42.42.5(pid=8588): stderr: | 20221209014818136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014818136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014818137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014818137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014818137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014818137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014818138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:19.555405 run osmo-stp_10.42.42.5(pid=8588): stdout: | (launched: 2022-12-09_01:48:17.968399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:19.675936 run osmo-stp_10.42.42.5(pid=8588): stderr: | 20221209014818136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014818136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014818137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014818137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014818137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014818137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014818138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:19.820740 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8588): Process ended prematurely: osmo-stp_10.42.42.5(pid=8588) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8588)] [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:48:19.829781 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:48:19.856682 run osmo-hlr_10.42.42.2(pid=8585): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8585)] 01:48:19.904838 run osmo-hlr_10.42.42.2(pid=8585): stdout: | (launched: 2022-12-09_01:48:16.913184) 01:48:19.954705 run osmo-hlr_10.42.42.2(pid=8585): stderr: | 20221209014817112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014817112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014817112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014817112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014817112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014817112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014817127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014817139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014817139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014817139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:20.024256 run osmo-msc_10.42.42.6(pid=8591): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8591)] 01:48:20.072317 run osmo-msc_10.42.42.6(pid=8591): stdout: | (launched: 2022-12-09_01:48:18.940371) 01:48:20.121869 run osmo-msc_10.42.42.6(pid=8591): stderr: | 20221209014819210 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014819210 DLGLOBAL DEBUG validating counter group 0x7f06862a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014819210 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014819211 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014819211 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014819211 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014819213 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014819213 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014819213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014819213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:20.172127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8584): Terminating (SIGTERM) 01:48:20.212076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8587): Terminating (SIGTERM) 01:48:20.252305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8590): Terminating (SIGTERM) 01:48:20.292761 --- ParallelTerminationStrategy: PID 8584 died... 01:48:20.312034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8584): Terminated: ok {rc=0} 01:48:20.356741 --- ParallelTerminationStrategy: PID 8587 died... 01:48:20.375522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8587): Terminated: ok {rc=0} 01:48:20.419936 --- ParallelTerminationStrategy: PID 8590 died... 01:48:20.438679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8590): Terminated: ok {rc=0} 01:48:20.524171 bus /sierra_3: Setting Powered False 01:48:21.625021 bus /sierra_3: Setting Powered False 01:48:22.741553 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:48:23.994688 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:48:24.001906 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:48:24.034281 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:48:24.060401 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:48:24.112540 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:48:24.144517 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:48:24.171012 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:48:24.726551 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:48:24.779748 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:24.791528 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:48:24.861154 tst mo_mt_call.py: using LAC 18225 01:48:24.988788 tst mo_mt_call.py: using RAC 120 01:48:25.115171 tst mo_mt_call.py: using CellId 18225 01:48:25.237144 tst mo_mt_call.py: using BVCI 18226 01:48:25.347239 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:25.358564 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:25.369746 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:25.381187 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:25.392481 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:25.403650 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:48:25.522041 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:48:25.637244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:26.106683 run create_hlr_db(pid=8596): Launched 01:48:26.224606 bus /sierra_2: Setting Powered False 01:48:27.285759 run create_hlr_db(pid=8596): Terminated: ok {rc=0} 01:48:27.708893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8598): Launched 01:48:28.012849 run osmo-hlr_10.42.42.2(pid=8599): Launched 01:48:28.129613 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:28.661706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8601): Launched 01:48:28.967796 run osmo-stp_10.42.42.5(pid=8602): Launched 01:48:29.084323 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:29.632603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8604): Launched 01:48:29.937686 run osmo-msc_10.42.42.6(pid=8605): Launched 01:48:30.108896 run osmo-stp_10.42.42.5(pid=8602): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8602)] 01:48:30.238661 run osmo-stp_10.42.42.5(pid=8602): stdout: | (launched: 2022-12-09_01:48:28.911849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:30.368137 run osmo-stp_10.42.42.5(pid=8602): stderr: | 20221209014829080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014829080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014829081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014829081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014829082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014829082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014829082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:30.495702 run osmo-stp_10.42.42.5(pid=8602): stdout: | (launched: 2022-12-09_01:48:28.911849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:30.616888 run osmo-stp_10.42.42.5(pid=8602): stderr: | 20221209014829080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014829080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014829081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014829081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014829082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014829082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014829082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:30.763536 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8602): Process ended prematurely: osmo-stp_10.42.42.5(pid=8602) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8602)] [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:48:30.772597 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:48:30.799786 run osmo-hlr_10.42.42.2(pid=8599): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8599)] 01:48:30.859623 run osmo-hlr_10.42.42.2(pid=8599): stdout: | (launched: 2022-12-09_01:48:27.957324) 01:48:30.920106 run osmo-hlr_10.42.42.2(pid=8599): stderr: | 20221209014828132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014828132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014828132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014828132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014828132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014828132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014828144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014828153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014828153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014828153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:30.999229 run osmo-msc_10.42.42.6(pid=8605): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8605)] 01:48:31.051112 run osmo-msc_10.42.42.6(pid=8605): stdout: | (launched: 2022-12-09_01:48:29.881538) 01:48:31.104518 run osmo-msc_10.42.42.6(pid=8605): stderr: | 20221209014830154 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014830154 DLGLOBAL DEBUG validating counter group 0x7efdf1cd5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014830154 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014830154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014830154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014830154 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014830156 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014830156 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014830157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014830157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:31.158486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8598): Terminating (SIGTERM) 01:48:31.202898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8601): Terminating (SIGTERM) 01:48:31.247817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8604): Terminating (SIGTERM) 01:48:31.294185 --- ParallelTerminationStrategy: PID 8598 died... 01:48:31.315165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8598): Terminated: ok {rc=0} 01:48:31.365383 --- ParallelTerminationStrategy: PID 8601 died... 01:48:31.385691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8601): Terminated: ok {rc=0} 01:48:31.433216 --- ParallelTerminationStrategy: PID 8604 died... 01:48:31.453900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8604): Terminated: ok {rc=0} 01:48:31.547216 bus /sierra_3: Setting Powered False 01:48:32.648136 bus /sierra_3: Setting Powered False 01:48:33.766897 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:48:34.913985 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:34.925861 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:48:34.992642 tst mo_mt_call_osmux.py: using LAC 18226 01:48:35.112696 tst mo_mt_call_osmux.py: using RAC 121 01:48:35.233726 tst mo_mt_call_osmux.py: using CellId 18226 01:48:35.354714 tst mo_mt_call_osmux.py: using BVCI 18227 01:48:35.467671 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:35.478917 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:35.489958 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:35.501284 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:35.512416 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:35.523676 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:48:35.637328 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:48:35.756655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:36.229183 run create_hlr_db(pid=8607): Launched 01:48:36.345369 bus /sierra_2: Setting Powered False 01:48:37.406349 run create_hlr_db(pid=8607): Terminated: ok {rc=0} 01:48:37.851893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8609): Launched 01:48:38.178821 run osmo-hlr_10.42.42.2(pid=8610): Launched 01:48:38.304801 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:38.868105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8612): Launched 01:48:39.194037 run osmo-stp_10.42.42.5(pid=8613): Launched 01:48:39.318200 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:39.905496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8615): Launched 01:48:40.234129 run osmo-msc_10.42.42.6(pid=8616): Launched 01:48:40.419336 run osmo-stp_10.42.42.5(pid=8613): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8613)] 01:48:40.556137 run osmo-stp_10.42.42.5(pid=8613): stdout: | (launched: 2022-12-09_01:48:39.133939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:40.695413 run osmo-stp_10.42.42.5(pid=8613): stderr: | 20221209014839327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014839327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014839327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014839327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014839328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014839328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014839328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:40.831976 run osmo-stp_10.42.42.5(pid=8613): stdout: | (launched: 2022-12-09_01:48:39.133939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:40.961222 run osmo-stp_10.42.42.5(pid=8613): stderr: | 20221209014839327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014839327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014839327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014839327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014839328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014839328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014839328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:41.116068 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8613): Process ended prematurely: osmo-stp_10.42.42.5(pid=8613) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8613)] [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:48:41.125689 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:48:41.153555 run osmo-hlr_10.42.42.2(pid=8610): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8610)] 01:48:41.204085 run osmo-hlr_10.42.42.2(pid=8610): stdout: | (launched: 2022-12-09_01:48:38.119007) 01:48:41.256183 run osmo-hlr_10.42.42.2(pid=8610): stderr: | 20221209014838316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014838316 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014838316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014838316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014838316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014838316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014838334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014838344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014838344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014838344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:41.328855 run osmo-msc_10.42.42.6(pid=8616): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8616)] 01:48:41.379082 run osmo-msc_10.42.42.6(pid=8616): stdout: | (launched: 2022-12-09_01:48:40.173951) 01:48:41.431002 run osmo-msc_10.42.42.6(pid=8616): stderr: | 20221209014840496 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014840496 DLGLOBAL DEBUG validating counter group 0x7f417c8ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014840496 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014840496 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014840496 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014840497 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014840498 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014840499 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014840499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014840499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:41.483274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8609): Terminating (SIGTERM) 01:48:41.525315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8612): Terminating (SIGTERM) 01:48:41.567401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8615): Terminating (SIGTERM) 01:48:41.609705 --- ParallelTerminationStrategy: PID 8609 died... 01:48:41.629774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8609): Terminated: ok {rc=0} 01:48:41.676066 --- ParallelTerminationStrategy: PID 8612 died... 01:48:41.695611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8612): Terminated: ok {rc=0} 01:48:41.741794 --- ParallelTerminationStrategy: PID 8615 died... 01:48:41.761522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8615): Terminated: ok {rc=0} 01:48:41.849472 bus /sierra_3: Setting Powered False 01:48:42.948569 bus /sierra_3: Setting Powered False 01:48:44.065527 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:48:45.311258 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:48:45.318509 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:48:45.351225 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:48:45.378013 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:48:45.431226 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:48:45.465339 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:48:45.492510 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:48:46.055342 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:48:46.108357 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:46.120631 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:48:46.190447 tst mo_mt_call.py: using LAC 18227 01:48:46.321134 tst mo_mt_call.py: using RAC 122 01:48:46.445250 tst mo_mt_call.py: using CellId 18227 01:48:46.577389 tst mo_mt_call.py: using BVCI 18228 01:48:46.698505 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:46.710773 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:46.722866 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:46.736022 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:46.749414 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:46.761771 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:46.894764 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:47.014528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:47.537358 run create_hlr_db(pid=8621): Launched 01:48:47.655170 bus /sierra_2: Setting Powered False 01:48:48.715511 run create_hlr_db(pid=8621): Terminated: ok {rc=0} 01:48:49.140577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8623): Launched 01:48:49.447223 run osmo-hlr_10.42.42.2(pid=8624): Launched 01:48:49.564368 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:50.105172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8626): Launched 01:48:50.410102 run osmo-stp_10.42.42.5(pid=8627): Launched 01:48:50.526479 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:51.076323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8629): Launched 01:48:51.403371 run osmo-msc_10.42.42.6(pid=8630): Launched 01:48:51.585285 run osmo-stp_10.42.42.5(pid=8627): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8627)] 01:48:51.722280 run osmo-stp_10.42.42.5(pid=8627): stdout: | (launched: 2022-12-09_01:48:50.354044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:51.859328 run osmo-stp_10.42.42.5(pid=8627): stderr: | 20221209014850522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014850523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014850523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014850523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014850524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014850524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014850524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:51.995897 run osmo-stp_10.42.42.5(pid=8627): stdout: | (launched: 2022-12-09_01:48:50.354044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:52.125027 run osmo-stp_10.42.42.5(pid=8627): stderr: | 20221209014850522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014850523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014850523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014850523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014850524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014850524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014850524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:52.279906 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8627): Process ended prematurely: osmo-stp_10.42.42.5(pid=8627) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8627)] [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:48:52.289532 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:48:52.317502 run osmo-hlr_10.42.42.2(pid=8624): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8624)] 01:48:52.367920 run osmo-hlr_10.42.42.2(pid=8624): stdout: | (launched: 2022-12-09_01:48:49.391246) 01:48:52.420007 run osmo-hlr_10.42.42.2(pid=8624): stderr: | 20221209014849567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014849567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014849567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014849567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014849567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014849567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014849579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014849588 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014849588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014849588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:52.493147 run osmo-msc_10.42.42.6(pid=8630): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8630)] 01:48:52.543456 run osmo-msc_10.42.42.6(pid=8630): stdout: | (launched: 2022-12-09_01:48:51.344131) 01:48:52.595512 run osmo-msc_10.42.42.6(pid=8630): stderr: | 20221209014851666 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014851667 DLGLOBAL DEBUG validating counter group 0x7f5b3fe7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014851667 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014851667 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014851667 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014851667 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014851669 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014851669 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014851670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014851670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:52.647535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8623): Terminating (SIGTERM) 01:48:52.689295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8626): Terminating (SIGTERM) 01:48:52.731003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8629): Terminating (SIGTERM) 01:48:52.773233 --- ParallelTerminationStrategy: PID 8623 died... 01:48:52.793311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8623): Terminated: ok {rc=0} 01:48:52.839577 --- ParallelTerminationStrategy: PID 8626 died... 01:48:52.859147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8626): Terminated: ok {rc=0} 01:48:52.905407 --- ParallelTerminationStrategy: PID 8629 died... 01:48:52.925545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8629): Terminated: ok {rc=0} 01:48:53.013260 bus /sierra_3: Setting Powered False 01:48:54.112385 bus /sierra_3: Setting Powered False 01:48:55.227567 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:48:56.375150 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:56.387141 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:48:56.454673 tst mo_mt_call_osmux.py: using LAC 18228 01:48:56.574677 tst mo_mt_call_osmux.py: using RAC 123 01:48:56.693872 tst mo_mt_call_osmux.py: using CellId 18228 01:48:56.817024 tst mo_mt_call_osmux.py: using BVCI 18229 01:48:56.935342 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:56.947265 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:56.959075 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:56.970754 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:56.982444 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:56.993979 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:57.113469 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:57.230879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:57.702690 run create_hlr_db(pid=8632): Launched 01:48:57.819934 bus /sierra_2: Setting Powered False 01:48:58.881028 run create_hlr_db(pid=8632): Terminated: ok {rc=0} 01:48:59.327666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8634): Launched 01:48:59.653357 run osmo-hlr_10.42.42.2(pid=8635): Launched 01:48:59.781580 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:00.343929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8637): Launched 01:49:00.670097 run osmo-stp_10.42.42.5(pid=8638): Launched 01:49:00.796291 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:01.483282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8640): Launched 01:49:01.822758 run osmo-msc_10.42.42.6(pid=8641): Launched 01:49:02.142287 run osmo-stp_10.42.42.5(pid=8638): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8638)] 01:49:02.388163 run osmo-stp_10.42.42.5(pid=8638): stdout: | (launched: 2022-12-09_01:49:00.610257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:02.523902 run osmo-stp_10.42.42.5(pid=8638): stderr: | 20221209014900803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014900803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014900804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014900804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014900805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014900805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014900805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:02.659929 run osmo-stp_10.42.42.5(pid=8638): stdout: | (launched: 2022-12-09_01:49:00.610257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:02.789414 run osmo-stp_10.42.42.5(pid=8638): stderr: | 20221209014900803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014900803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014900804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014900804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014900805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014900805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014900805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:02.944208 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8638): Process ended prematurely: osmo-stp_10.42.42.5(pid=8638) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8638)] [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:49:02.953955 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 01:49:02.981881 run osmo-hlr_10.42.42.2(pid=8635): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8635)] 01:49:03.032088 run osmo-hlr_10.42.42.2(pid=8635): stdout: | (launched: 2022-12-09_01:48:59.594054) 01:49:03.084038 run osmo-hlr_10.42.42.2(pid=8635): stderr: | 20221209014859793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014859793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014859793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014859793 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014859793 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014859793 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014859805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014859814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014859814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014859814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:03.155952 run osmo-msc_10.42.42.6(pid=8641): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8641)] 01:49:03.206224 run osmo-msc_10.42.42.6(pid=8641): stdout: | (launched: 2022-12-09_01:49:01.763237) 01:49:03.258181 run osmo-msc_10.42.42.6(pid=8641): stderr: | 20221209014902324 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014902324 DLGLOBAL DEBUG validating counter group 0x7f7a57526c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014902324 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014902324 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014902324 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014902324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014902326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014902327 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014902327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014902327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:03.310048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8634): Terminating (SIGTERM) 01:49:03.352002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8637): Terminating (SIGTERM) 01:49:03.393917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8640): Terminating (SIGTERM) 01:49:03.436160 --- ParallelTerminationStrategy: PID 8634 died... 01:49:03.456386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8634): Terminated: ok {rc=0} 01:49:03.503196 --- ParallelTerminationStrategy: PID 8637 died... 01:49:03.522986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8637): Terminated: ok {rc=0} 01:49:03.569294 --- ParallelTerminationStrategy: PID 8640 died... 01:49:03.588735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8640): Terminated: ok {rc=0} 01:49:03.676545 bus /sierra_3: Setting Powered False 01:49:04.774929 bus /sierra_3: Setting Powered False 01:49:05.890557 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:49:07.147696 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:49:07.156522 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:49:07.189688 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:49:07.216827 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:49:07.270547 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:49:07.303929 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:49:07.331307 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:49:07.882973 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:49:07.935010 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:07.946741 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:49:08.016355 tst mo_mt_call.py: using LAC 18229 01:49:08.143068 tst mo_mt_call.py: using RAC 124 01:49:08.270671 tst mo_mt_call.py: using CellId 18229 01:49:08.397626 tst mo_mt_call.py: using BVCI 18230 01:49:08.517433 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:08.529140 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:08.540648 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:08.552207 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:08.563833 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:08.575809 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:49:08.692219 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:49:08.815346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:09.319974 run create_hlr_db(pid=8646): Launched 01:49:09.452133 bus /sierra_2: Setting Powered False 01:49:10.517018 run create_hlr_db(pid=8646): Terminated: ok {rc=0} 01:49:10.951015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8648): Launched 01:49:11.257203 run osmo-hlr_10.42.42.2(pid=8649): Launched 01:49:11.374681 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:11.916137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8651): Launched 01:49:12.222556 run osmo-stp_10.42.42.5(pid=8652): Launched 01:49:12.342584 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:12.894259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8654): Launched 01:49:13.198898 run osmo-msc_10.42.42.6(pid=8655): Launched 01:49:13.369882 run osmo-stp_10.42.42.5(pid=8652): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8652)] 01:49:13.498385 run osmo-stp_10.42.42.5(pid=8652): stdout: | (launched: 2022-12-09_01:49:12.166252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:13.626516 run osmo-stp_10.42.42.5(pid=8652): stderr: | 20221209014912335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014912335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014912335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014912336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014912336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014912337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014912337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:13.752748 run osmo-stp_10.42.42.5(pid=8652): stdout: | (launched: 2022-12-09_01:49:12.166252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:13.873359 run osmo-stp_10.42.42.5(pid=8652): stderr: | 20221209014912335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014912335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014912335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014912336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014912336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014912337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014912337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:14.017982 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8652): Process ended prematurely: osmo-stp_10.42.42.5(pid=8652) [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8652)] [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:49:14.026970 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:49:14.054123 run osmo-hlr_10.42.42.2(pid=8649): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8649)] 01:49:14.102175 run osmo-hlr_10.42.42.2(pid=8649): stdout: | (launched: 2022-12-09_01:49:11.201434) 01:49:14.151902 run osmo-hlr_10.42.42.2(pid=8649): stderr: | 20221209014911379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014911379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014911379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014911379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014911379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014911379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014911390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014911399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014911399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014911399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:14.221585 run osmo-msc_10.42.42.6(pid=8655): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8655)] 01:49:14.270221 run osmo-msc_10.42.42.6(pid=8655): stdout: | (launched: 2022-12-09_01:49:13.143259) 01:49:14.320021 run osmo-msc_10.42.42.6(pid=8655): stderr: | 20221209014913415 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014913415 DLGLOBAL DEBUG validating counter group 0x7f45bd4cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014913415 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014913415 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014913415 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014913415 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014913417 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014913417 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014913418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014913418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:14.370202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8648): Terminating (SIGTERM) 01:49:14.410112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8651): Terminating (SIGTERM) 01:49:14.450036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8654): Terminating (SIGTERM) 01:49:14.490464 --- ParallelTerminationStrategy: PID 8648 died... 01:49:14.509665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8648): Terminated: ok {rc=0} 01:49:14.554140 --- ParallelTerminationStrategy: PID 8651 died... 01:49:14.572688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8651): Terminated: ok {rc=0} 01:49:14.617075 --- ParallelTerminationStrategy: PID 8654 died... 01:49:14.635676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8654): Terminated: ok {rc=0} 01:49:14.720125 bus /sierra_3: Setting Powered False 01:49:15.816314 bus /sierra_3: Setting Powered False 01:49:16.957447 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:49:18.110325 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:18.122255 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:49:18.190279 tst mo_mt_call_osmux.py: using LAC 18230 01:49:18.309645 tst mo_mt_call_osmux.py: using RAC 125 01:49:18.429141 tst mo_mt_call_osmux.py: using CellId 18230 01:49:18.547882 tst mo_mt_call_osmux.py: using BVCI 18231 01:49:18.658342 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:18.669647 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:18.680579 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:18.691789 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:18.703365 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:49:18.714578 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:49:18.830987 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:49:18.947121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:19.421445 run create_hlr_db(pid=8657): Launched 01:49:19.537686 bus /sierra_2: Setting Powered False 01:49:20.598560 run create_hlr_db(pid=8657): Terminated: ok {rc=0} 01:49:21.022882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8659): Launched 01:49:21.327870 run osmo-hlr_10.42.42.2(pid=8660): Launched 01:49:21.444131 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:21.970264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8662): Launched 01:49:22.274800 run osmo-stp_10.42.42.5(pid=8663): Launched 01:49:22.391464 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:22.940818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8665): Launched 01:49:23.246663 run osmo-msc_10.42.42.6(pid=8666): Launched 01:49:23.418379 run osmo-stp_10.42.42.5(pid=8663): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8663)] 01:49:23.547727 run osmo-stp_10.42.42.5(pid=8663): stdout: | (launched: 2022-12-09_01:49:22.218954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:23.676649 run osmo-stp_10.42.42.5(pid=8663): stderr: | 20221209014922390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014922390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014922390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014922391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014922391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014922391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014922391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:23.803551 run osmo-stp_10.42.42.5(pid=8663): stdout: | (launched: 2022-12-09_01:49:22.218954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:23.924422 run osmo-stp_10.42.42.5(pid=8663): stderr: | 20221209014922390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014922390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014922390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014922391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014922391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014922391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014922391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:24.069601 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8663): Process ended prematurely: osmo-stp_10.42.42.5(pid=8663) [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8663)] [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:49:24.078304 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 01:49:24.105464 run osmo-hlr_10.42.42.2(pid=8660): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8660)] 01:49:24.153368 run osmo-hlr_10.42.42.2(pid=8660): stdout: | (launched: 2022-12-09_01:49:21.272212) 01:49:24.203032 run osmo-hlr_10.42.42.2(pid=8660): stderr: | 20221209014921448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014921448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014921448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014921448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014921448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014921448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014921461 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014921470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014921470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014921470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:24.272087 run osmo-msc_10.42.42.6(pid=8666): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8666)] 01:49:24.319821 run osmo-msc_10.42.42.6(pid=8666): stdout: | (launched: 2022-12-09_01:49:23.190460) 01:49:24.369377 run osmo-msc_10.42.42.6(pid=8666): stderr: | 20221209014923461 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014923461 DLGLOBAL DEBUG validating counter group 0x7ff32e48ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014923461 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014923461 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014923461 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014923462 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014923463 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014923464 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014923464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014923464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:24.419464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8659): Terminating (SIGTERM) 01:49:24.459420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8662): Terminating (SIGTERM) 01:49:24.499329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8665): Terminating (SIGTERM) 01:49:24.539383 --- ParallelTerminationStrategy: PID 8659 died... 01:49:24.558639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8659): Terminated: ok {rc=0} 01:49:24.603012 --- ParallelTerminationStrategy: PID 8662 died... 01:49:24.621620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8662): Terminated: ok {rc=0} 01:49:24.665805 --- ParallelTerminationStrategy: PID 8665 died... 01:49:24.685011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8665): Terminated: ok {rc=0} 01:49:24.771037 bus /sierra_3: Setting Powered False 01:49:25.869221 bus /sierra_3: Setting Powered False 01:49:26.984029 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:49:28.240127 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:49:28.247766 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:49:28.281560 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 01:49:28.309418 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 01:49:28.363304 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:49:28.397239 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 01:49:28.425133 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 01:49:28.973269 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 01:49:29.023429 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:29.034816 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:49:29.085357 tst mo_mt_call.py: using LAC 18231 01:49:29.205230 tst mo_mt_call.py: using RAC 126 01:49:29.326460 tst mo_mt_call.py: using CellId 18231 01:49:29.449041 tst mo_mt_call.py: using BVCI 18232 01:49:29.561060 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:29.572299 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:29.583496 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:29.594913 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:29.606512 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:29.617931 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:49:29.733232 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:49:29.848911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:30.319611 run create_hlr_db(pid=8671): Launched 01:49:30.436647 bus /sierra_2: Setting Powered False 01:49:31.501173 run create_hlr_db(pid=8671): Terminated: ok {rc=0} 01:49:31.938214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8673): Launched 01:49:32.262960 run osmo-hlr_10.42.42.2(pid=8674): Launched 01:49:32.381240 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:32.919946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8676): Launched 01:49:33.225888 run osmo-stp_10.42.42.5(pid=8677): Launched 01:49:33.345575 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:33.910847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8679): Launched 01:49:34.216789 run osmo-msc_10.42.42.6(pid=8680): Launched 01:49:34.390729 run osmo-stp_10.42.42.5(pid=8677): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8677)] 01:49:34.519628 run osmo-stp_10.42.42.5(pid=8677): stdout: | (launched: 2022-12-09_01:49:33.169610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:34.649376 run osmo-stp_10.42.42.5(pid=8677): stderr: | 20221209014933339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014933339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014933340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014933340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014933341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014933341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014933341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:34.776399 run osmo-stp_10.42.42.5(pid=8677): stdout: | (launched: 2022-12-09_01:49:33.169610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:34.897670 run osmo-stp_10.42.42.5(pid=8677): stderr: | 20221209014933339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014933339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014933340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014933340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014933341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014933341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014933341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:35.043213 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8677): Process ended prematurely: osmo-stp_10.42.42.5(pid=8677) [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8677)] [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 01:49:35.052265 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:49:35.080495 run osmo-hlr_10.42.42.2(pid=8674): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8674)] 01:49:35.129318 run osmo-hlr_10.42.42.2(pid=8674): stdout: | (launched: 2022-12-09_01:49:32.205351) 01:49:35.179858 run osmo-hlr_10.42.42.2(pid=8674): stderr: | 20221209014932382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014932382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014932382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014932382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014932382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014932382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014932395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014932403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014932403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014932403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:35.250168 run osmo-msc_10.42.42.6(pid=8680): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8680)] 01:49:35.299121 run osmo-msc_10.42.42.6(pid=8680): stdout: | (launched: 2022-12-09_01:49:34.160829) 01:49:35.349764 run osmo-msc_10.42.42.6(pid=8680): stderr: | 20221209014934433 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014934434 DLGLOBAL DEBUG validating counter group 0x7fe5d549fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014934434 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014934434 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014934434 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014934434 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014934436 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014934436 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014934436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014934436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:35.400419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8673): Terminating (SIGTERM) 01:49:35.441160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8676): Terminating (SIGTERM) 01:49:35.481795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8679): Terminating (SIGTERM) 01:49:35.522755 --- ParallelTerminationStrategy: PID 8673 died... 01:49:35.542251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8673): Terminated: ok {rc=0} 01:49:35.587819 --- ParallelTerminationStrategy: PID 8676 died... 01:49:35.606996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8676): Terminated: ok {rc=0} 01:49:35.652209 --- ParallelTerminationStrategy: PID 8679 died... 01:49:35.671370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8679): Terminated: ok {rc=0} 01:49:35.758895 bus /sierra_3: Setting Powered False 01:49:36.858823 bus /sierra_3: Setting Powered False 01:49:37.976179 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 01:49:39.124025 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:39.136264 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:49:39.187634 tst mo_mt_call_osmux.py: using LAC 18232 01:49:39.309934 tst mo_mt_call_osmux.py: using RAC 127 01:49:39.431362 tst mo_mt_call_osmux.py: using CellId 18232 01:49:39.557745 tst mo_mt_call_osmux.py: using BVCI 18233 01:49:39.678398 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:39.690552 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:39.702430 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:39.714176 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:39.726298 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:39.738248 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:49:39.853277 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:49:39.969121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:40.441808 run create_hlr_db(pid=8682): Launched 01:49:40.559841 bus /sierra_2: Setting Powered False 01:49:41.621397 run create_hlr_db(pid=8682): Terminated: ok {rc=0} 01:49:42.069073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8684): Launched 01:49:42.396149 run osmo-hlr_10.42.42.2(pid=8685): Launched 01:49:42.522672 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:43.087563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8687): Launched 01:49:43.417570 run osmo-stp_10.42.42.5(pid=8688): Launched 01:49:43.544535 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:44.138218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8690): Launched 01:49:44.466347 run osmo-msc_10.42.42.6(pid=8691): Launched 01:49:44.650117 run osmo-stp_10.42.42.5(pid=8688): ERR: Terminated: ERROR {rc=1} [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8688)] 01:49:44.787902 run osmo-stp_10.42.42.5(pid=8688): stdout: | (launched: 2022-12-09_01:49:43.358056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:44.926316 run osmo-stp_10.42.42.5(pid=8688): stderr: | 20221209014943550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014943550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014943551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014943551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014943552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014943552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014943552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:45.063239 run osmo-stp_10.42.42.5(pid=8688): stdout: | (launched: 2022-12-09_01:49:43.358056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:45.193205 run osmo-stp_10.42.42.5(pid=8688): stderr: | 20221209014943550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014943550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014943551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014943551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014943552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014943552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014943552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:45.350071 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8688): Process ended prematurely: osmo-stp_10.42.42.5(pid=8688) [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8688)] [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 01:49:45.359763 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:49:45.388529 run osmo-hlr_10.42.42.2(pid=8685): ERR: Terminated: ERROR {rc=237} [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8685)] 01:49:45.439156 run osmo-hlr_10.42.42.2(pid=8685): stdout: | (launched: 2022-12-09_01:49:42.336495) 01:49:45.491645 run osmo-hlr_10.42.42.2(pid=8685): stderr: | 20221209014942533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014942533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014942533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014942533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014942533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014942533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014942546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014942556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014942556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014942556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:45.564789 run osmo-msc_10.42.42.6(pid=8691): ERR: Terminated: ERROR {rc=2} [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8691)] 01:49:45.615066 run osmo-msc_10.42.42.6(pid=8691): stdout: | (launched: 2022-12-09_01:49:44.406446) 01:49:45.667155 run osmo-msc_10.42.42.6(pid=8691): stderr: | 20221209014944729 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014944730 DLGLOBAL DEBUG validating counter group 0x7fefd5a6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014944730 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014944730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014944730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014944731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014944732 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014944733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014944733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014944733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:45.719849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8684): Terminating (SIGTERM) 01:49:45.762012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8687): Terminating (SIGTERM) 01:49:45.804301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8690): Terminating (SIGTERM) 01:49:45.851460 --- ParallelTerminationStrategy: PID 8684 died... 01:49:45.880352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8684): Terminated: ok {rc=0} 01:49:45.927726 --- ParallelTerminationStrategy: PID 8687 died... 01:49:45.947522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8687): Terminated: ok {rc=0} 01:49:45.996541 --- ParallelTerminationStrategy: PID 8690 died... 01:49:46.017375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8690): Terminated: ok {rc=0} 01:49:46.106594 bus /sierra_3: Setting Powered False 01:49:47.205975 bus /sierra_3: Setting Powered False 01:49:48.324434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 emergency:nanobts+band-900 --------------------------------------------------------------------- 01:49:49.575482 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:49:49.580697 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:49:49.613597 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 01:49:49.639913 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 01:49:49.726976 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:49:49.760863 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 01:49:49.787820 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 01:49:50.365806 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2352 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 01:49:50.370991 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:50.381848 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 01:49:50.434178 tst emergency_mo_mt_call.py: using LAC 18233 01:49:50.552489 tst emergency_mo_mt_call.py: using RAC 128 01:49:50.682362 tst emergency_mo_mt_call.py: using CellId 18233 01:49:50.807388 tst emergency_mo_mt_call.py: using BVCI 18234 01:49:50.925214 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:50.936828 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:50.947981 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:50.959304 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:50.970656 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:50.981997 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:51.101759 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:51.220519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:51.717461 run create_hlr_db(pid=8696): Launched 01:49:51.847630 bus /sierra_2: Setting Powered False 01:49:52.910864 run create_hlr_db(pid=8696): Terminated: ok {rc=0} 01:49:53.357997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8698): Launched 01:49:53.680186 run osmo-hlr_10.42.42.2(pid=8699): Launched 01:49:53.802361 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:54.357663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8701): Launched 01:49:54.677375 run osmo-stp_10.42.42.5(pid=8702): Launched 01:49:54.810311 tst emergency_mo_mt_call.py: using MSISDN 6958 01:49:54.973165 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:55.550372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8704): Launched 01:49:55.871958 run osmo-msc_10.42.42.6(pid=8705): Launched 01:49:56.050794 run osmo-stp_10.42.42.5(pid=8702): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8702)] 01:49:56.185242 run osmo-stp_10.42.42.5(pid=8702): stdout: | (launched: 2022-12-09_01:49:54.619053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:56.320541 run osmo-stp_10.42.42.5(pid=8702): stderr: | 20221209014954811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014954811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014954811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014954812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014954812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014954812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014954812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:56.455177 run osmo-stp_10.42.42.5(pid=8702): stdout: | (launched: 2022-12-09_01:49:54.619053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:56.582485 run osmo-stp_10.42.42.5(pid=8702): stderr: | 20221209014954811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209014954811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209014954811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209014954812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209014954812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209014954812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209014954812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:56.734666 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8702): Process ended prematurely: osmo-stp_10.42.42.5(pid=8702) [trial-2352↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8702)] [trial-2352↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 01:49:56.743630 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 01:49:56.771311 run osmo-hlr_10.42.42.2(pid=8699): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8699)] 01:49:56.821761 run osmo-hlr_10.42.42.2(pid=8699): stdout: | (launched: 2022-12-09_01:49:53.621843) 01:49:56.874166 run osmo-hlr_10.42.42.2(pid=8699): stderr: | 20221209014953821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209014953821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209014953821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209014953821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209014953821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209014953821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209014953833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209014953842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209014953842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209014953842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:56.947292 run osmo-msc_10.42.42.6(pid=8705): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8705)] 01:49:56.997707 run osmo-msc_10.42.42.6(pid=8705): stdout: | (launched: 2022-12-09_01:49:55.813554) 01:49:57.049683 run osmo-msc_10.42.42.6(pid=8705): stderr: | 20221209014956135 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209014956136 DLGLOBAL DEBUG validating counter group 0x7f14ef578c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209014956136 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209014956136 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209014956136 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209014956136 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209014956138 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209014956138 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209014956139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209014956139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:57.102070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8698): Terminating (SIGTERM) 01:49:57.143985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8701): Terminating (SIGTERM) 01:49:57.186056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8704): Terminating (SIGTERM) 01:49:57.228855 --- ParallelTerminationStrategy: PID 8698 died... 01:49:57.248873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8698): Terminated: ok {rc=0} 01:49:57.295710 --- ParallelTerminationStrategy: PID 8701 died... 01:49:57.315498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8701): Terminated: ok {rc=0} 01:49:57.361930 --- ParallelTerminationStrategy: PID 8704 died... 01:49:57.381732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8704): Terminated: ok {rc=0} 01:49:57.471023 bus /sierra_3: Setting Powered False 01:49:58.571459 bus /sierra_3: Setting Powered False 01:49:59.687617 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 01:50:00.774823 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:50:00.786887 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 01:50:00.844845 tst emergency_preemptive_call.py: using LAC 18234 01:50:00.983624 tst emergency_preemptive_call.py: using RAC 129 01:50:01.110794 tst emergency_preemptive_call.py: using CellId 18234 01:50:01.232603 tst emergency_preemptive_call.py: using BVCI 18235 01:50:01.352470 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:50:01.364384 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:50:01.376216 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:50:01.387975 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:50:01.399842 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:50:01.411554 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:01.531615 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:01.655765 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:01.781680 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:01.899955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:02.382355 run create_hlr_db(pid=8710): Launched 01:50:02.525775 bus /sierra_2: Setting Powered False 01:50:03.585543 run create_hlr_db(pid=8710): Terminated: ok {rc=0} 01:50:04.036539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8712): Launched 01:50:04.361181 run osmo-hlr_10.42.42.2(pid=8713): Launched 01:50:04.483391 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:05.035507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8715): Launched 01:50:05.358252 run osmo-stp_10.42.42.5(pid=8716): Launched 01:50:05.491337 tst emergency_preemptive_call.py: using MSISDN 6959 01:50:05.654871 run osmo-msc_10.42.42.6: Starting osmo-msc 01:50:06.232709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8718): Launched 01:50:06.554386 run osmo-msc_10.42.42.6(pid=8719): Launched 01:50:06.736659 run osmo-stp_10.42.42.5(pid=8716): ERR: Terminated: ERROR {rc=1} [trial-2352↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8716)] 01:50:06.874330 run osmo-stp_10.42.42.5(pid=8716): stdout: | (launched: 2022-12-09_01:50:05.299627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:07.011331 run osmo-stp_10.42.42.5(pid=8716): stderr: | 20221209015005492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015005492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015005492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015005492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015005493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015005493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015005493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:07.147152 run osmo-stp_10.42.42.5(pid=8716): stdout: | (launched: 2022-12-09_01:50:05.299627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:07.275996 run osmo-stp_10.42.42.5(pid=8716): stderr: | 20221209015005492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015005492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015005492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015005492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015005493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015005493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015005493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:07.429341 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8716): Process ended prematurely: osmo-stp_10.42.42.5(pid=8716) [trial-2352↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8716)] [trial-2352↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 01:50:07.438429 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 01:50:07.466233 run osmo-hlr_10.42.42.2(pid=8713): ERR: Terminated: ERROR {rc=237} [trial-2352↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8713)] 01:50:07.517305 run osmo-hlr_10.42.42.2(pid=8713): stdout: | (launched: 2022-12-09_01:50:04.301603) 01:50:07.569955 run osmo-hlr_10.42.42.2(pid=8713): stderr: | 20221209015004499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015004499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015004499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015004499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015004499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015004499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015004511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015004520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015004520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015004520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:07.643291 run osmo-msc_10.42.42.6(pid=8719): ERR: Terminated: ERROR {rc=2} [trial-2352↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8719)] 01:50:07.694194 run osmo-msc_10.42.42.6(pid=8719): stdout: | (launched: 2022-12-09_01:50:06.495260) 01:50:07.746399 run osmo-msc_10.42.42.6(pid=8719): stderr: | 20221209015006817 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015006817 DLGLOBAL DEBUG validating counter group 0x7f805b63ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015006817 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015006817 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015006817 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015006817 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015006819 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015006819 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015006820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015006820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:50:07.799107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8712): Terminating (SIGTERM) 01:50:07.841432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8715): Terminating (SIGTERM) 01:50:07.883865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8718): Terminating (SIGTERM) 01:50:07.926908 --- ParallelTerminationStrategy: PID 8712 died... 01:50:07.947099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8712): Terminated: ok {rc=0} 01:50:07.993861 --- ParallelTerminationStrategy: PID 8715 died... 01:50:08.013682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8715): Terminated: ok {rc=0} 01:50:08.060012 --- ParallelTerminationStrategy: PID 8718 died... 01:50:08.080047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8718): Terminated: ok {rc=0} 01:50:08.169214 bus /sierra_9: Setting Powered False 01:50:09.268419 bus /sierra_9: Setting Powered False 01:50:10.387028 bus /sierra_8: Setting Powered False 01:50:11.486130 bus /sierra_8: Setting Powered False 01:50:12.602590 bus /sierra_3: Setting Powered False 01:50:13.701532 bus /sierra_3: Setting Powered False 01:50:14.815162 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-900 --------------------------------------------------------------------- 01:50:16.103547 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:50:16.108778 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:50:16.143952 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 01:50:16.184785 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 01:50:16.275997 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:50:16.318971 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 01:50:16.359422 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 01:50:16.940861 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 01:50:17.014155 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:17.027097 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:50:17.083014 tst cs_paging_gprs_active.py: using LAC 18235 01:50:17.237276 tst cs_paging_gprs_active.py: using RAC 130 01:50:17.359433 tst cs_paging_gprs_active.py: using CellId 18235 01:50:17.485300 tst cs_paging_gprs_active.py: using BVCI 18236 01:50:17.599037 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:17.610096 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:17.620675 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:17.632127 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:17.643345 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:17.654543 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:17.665938 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:17.676920 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:17.688322 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:17.807344 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:17.927405 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:50:18.134282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:18.441400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8724): Launched 01:50:18.710100 run iperf3-srv_10.42.42.10(pid=8725): Launched 01:50:18.826171 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:50:19.030966 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:19.338642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8726): Launched 01:50:19.605384 run iperf3-srv_10.42.42.10(pid=8727): Launched 01:50:19.721389 tst cs_paging_gprs_active.py:38: start network... 01:50:19.926833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:20.399898 run create_hlr_db(pid=8728): Launched 01:50:20.516765 bus /sierra_2: Setting Powered False 01:50:21.576684 run create_hlr_db(pid=8728): Terminated: ok {rc=0} 01:50:22.023663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8730): Launched 01:50:22.352686 run osmo-hlr_10.42.42.2(pid=8731): Launched 01:50:22.477630 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:23.041206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8733): Launched 01:50:23.368801 run osmo-stp_10.42.42.5(pid=8734): Launched 01:50:23.493387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:24.058625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8737): Launched 01:50:24.185763 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:24.463908 run patchelf(pid=8738): Launched 01:50:24.647179 run osmo-stp_10.42.42.5(pid=8734): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8734)] 01:50:24.786495 run osmo-stp_10.42.42.5(pid=8734): stdout: | (launched: 2022-12-09_01:50:23.309146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:24.927755 run osmo-stp_10.42.42.5(pid=8734): stderr: | 20221209015023500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015023500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015023500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015023501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015023501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015023501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015023501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:25.068748 run osmo-stp_10.42.42.5(pid=8734): stdout: | (launched: 2022-12-09_01:50:23.309146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:25.203298 run osmo-stp_10.42.42.5(pid=8734): stderr: | 20221209015023500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015023500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015023500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015023501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015023501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015023501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015023501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:25.363427 run patchelf(pid=8738): Terminating (SIGINT) 01:50:25.547572 run patchelf(pid=8738): Terminated: ok {rc=0} 01:50:25.681137 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8734): Process ended prematurely: osmo-stp_10.42.42.5(pid=8734) [trial-2352↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8734)] [trial-2352↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 01:50:25.691299 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:50:25.720261 run osmo-hlr_10.42.42.2(pid=8731): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8731)] 01:50:25.770534 run osmo-hlr_10.42.42.2(pid=8731): stdout: | (launched: 2022-12-09_01:50:22.292714) 01:50:25.822712 run osmo-hlr_10.42.42.2(pid=8731): stderr: | 20221209015022491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015022491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015022491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015022491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015022491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015022491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015022504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015022512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015022512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015022512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:25.875103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8724): Terminating (SIGTERM) 01:50:25.917648 run iperf3-srv_10.42.42.10(pid=8725): Terminating (SIGTERM) 01:50:25.959930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8726): Terminating (SIGTERM) 01:50:26.002392 run iperf3-srv_10.42.42.10(pid=8727): Terminating (SIGTERM) 01:50:26.044560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8730): Terminating (SIGTERM) 01:50:26.086995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8733): Terminating (SIGTERM) 01:50:26.129499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8737): Terminating (SIGTERM) 01:50:26.172195 --- ParallelTerminationStrategy: PID 8724 died... 01:50:26.192413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8724): Terminated: ok {rc=0} 01:50:26.239385 --- ParallelTerminationStrategy: PID 8725 died... 01:50:26.259161 run iperf3-srv_10.42.42.10(pid=8725): Terminated {rc=256} 01:50:26.305335 --- ParallelTerminationStrategy: PID 8726 died... 01:50:26.325170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8726): Terminated: ok {rc=0} 01:50:26.371360 --- ParallelTerminationStrategy: PID 8727 died... 01:50:26.391163 run iperf3-srv_10.42.42.10(pid=8727): Terminated {rc=256} 01:50:26.437415 --- ParallelTerminationStrategy: PID 8730 died... 01:50:26.457197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8730): Terminated: ok {rc=0} 01:50:26.503497 --- ParallelTerminationStrategy: PID 8733 died... 01:50:26.523319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8733): Terminated: ok {rc=0} 01:50:26.569593 --- ParallelTerminationStrategy: PID 8737 died... 01:50:26.589494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8737): Terminated: ok {rc=0} 01:50:26.677825 bus /gobi_0: Setting Powered False 01:50:27.778759 bus /gobi_0: Setting Powered False 01:50:28.897574 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 01:50:30.044441 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:30.055936 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:50:30.106920 tst iperf3.py: using LAC 18236 01:50:30.229275 tst iperf3.py: using RAC 131 01:50:30.350454 tst iperf3.py: using CellId 18236 01:50:30.475729 tst iperf3.py: using BVCI 18237 01:50:30.589782 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:30.600405 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:30.610907 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:30.621824 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:30.632556 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:30.643560 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:30.654582 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:30.665452 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:30.676520 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:30.792443 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:50:31.002418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:31.320684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8739): Launched 01:50:31.606009 run iperf3-srv_10.42.42.10(pid=8740): Launched 01:50:31.738393 tst iperf3.py:8: start network... 01:50:31.948325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:32.427503 run create_hlr_db(pid=8741): Launched 01:50:32.544409 bus /gobi_6: Setting Powered False 01:50:33.606054 run create_hlr_db(pid=8741): Terminated: ok {rc=0} 01:50:34.032629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8743): Launched 01:50:34.338917 run osmo-hlr_10.42.42.2(pid=8744): Launched 01:50:34.456849 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:34.997202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8746): Launched 01:50:35.303297 run osmo-stp_10.42.42.5(pid=8747): Launched 01:50:35.421211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:35.949180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8749): Launched 01:50:36.066736 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:36.325765 run patchelf(pid=8750): Launched 01:50:36.497147 run osmo-stp_10.42.42.5(pid=8747): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8747)] 01:50:36.627858 run osmo-stp_10.42.42.5(pid=8747): stdout: | (launched: 2022-12-09_01:50:35.247319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:36.759696 run osmo-stp_10.42.42.5(pid=8747): stderr: | 20221209015035418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015035418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015035418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015035419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015035419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015035419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015035419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:36.891980 run osmo-stp_10.42.42.5(pid=8747): stdout: | (launched: 2022-12-09_01:50:35.247319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:37.018082 run osmo-stp_10.42.42.5(pid=8747): stderr: | 20221209015035418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015035418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015035418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015035419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015035419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015035419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015035419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:37.167354 run patchelf(pid=8750): Terminating (SIGINT) 01:50:37.340608 run patchelf(pid=8750): Terminated: ok {rc=0} 01:50:37.465858 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8747): Process ended prematurely: osmo-stp_10.42.42.5(pid=8747) [trial-2352↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8747)] [trial-2352↪gprs:nanobts+band-900↪iperf3.py:8] 01:50:37.475341 tst iperf3.py:8: Test FAILED (7.5 sec) 01:50:37.503393 run osmo-hlr_10.42.42.2(pid=8744): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8744)] 01:50:37.551639 run osmo-hlr_10.42.42.2(pid=8744): stdout: | (launched: 2022-12-09_01:50:34.282842) 01:50:37.601354 run osmo-hlr_10.42.42.2(pid=8744): stderr: | 20221209015034459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015034459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015034459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015034459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015034459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015034459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015034471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015034480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015034480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015034480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:37.651809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8739): Terminating (SIGTERM) 01:50:37.691984 run iperf3-srv_10.42.42.10(pid=8740): Terminating (SIGTERM) 01:50:37.733243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8743): Terminating (SIGTERM) 01:50:37.777665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8746): Terminating (SIGTERM) 01:50:37.820104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8749): Terminating (SIGTERM) 01:50:37.862414 --- ParallelTerminationStrategy: PID 8739 died... 01:50:37.882648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8739): Terminated: ok {rc=0} 01:50:37.929455 --- ParallelTerminationStrategy: PID 8740 died... 01:50:37.949123 run iperf3-srv_10.42.42.10(pid=8740): Terminated {rc=256} 01:50:37.995459 --- ParallelTerminationStrategy: PID 8743 died... 01:50:38.015368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8743): Terminated: ok {rc=0} 01:50:38.062076 --- ParallelTerminationStrategy: PID 8746 died... 01:50:38.081843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8746): Terminated: ok {rc=0} 01:50:38.128489 --- ParallelTerminationStrategy: PID 8749 died... 01:50:38.148296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8749): Terminated: ok {rc=0} 01:50:38.236856 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 01:50:39.385007 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:39.396366 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:50:39.444835 tst iperf3m4.py: using LAC 18237 01:50:39.566319 tst iperf3m4.py: using RAC 132 01:50:39.686017 tst iperf3m4.py: using CellId 18237 01:50:39.808559 tst iperf3m4.py: using BVCI 18238 01:50:39.921401 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:39.932044 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:39.942605 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:39.953447 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:39.964068 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:39.974695 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:39.985591 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:39.996160 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:40.007236 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:40.128121 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:40.246206 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:40.362494 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:40.483415 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:50:40.705075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:41.032934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8751): Launched 01:50:41.317693 run iperf3-srv_10.42.42.10(pid=8752): Launched 01:50:41.443542 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:50:41.666078 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:41.997346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8753): Launched 01:50:42.282878 run iperf3-srv_10.42.42.10(pid=8754): Launched 01:50:42.407341 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:50:42.628644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:42.958431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8755): Launched 01:50:43.245268 run iperf3-srv_10.42.42.10(pid=8756): Launched 01:50:43.367875 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:50:43.588528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:43.917652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8757): Launched 01:50:44.204483 run iperf3-srv_10.42.42.10(pid=8758): Launched 01:50:44.327440 tst iperf3m4.py:8: start network... 01:50:44.548365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:45.056139 run create_hlr_db(pid=8759): Launched 01:50:45.190085 bus /gobi_6: Setting Powered False 01:50:46.253813 run create_hlr_db(pid=8759): Terminated: ok {rc=0} 01:50:46.707317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8761): Launched 01:50:47.061443 run osmo-hlr_10.42.42.2(pid=8762): Launched 01:50:47.206212 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:47.760789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8764): Launched 01:50:48.069119 run osmo-stp_10.42.42.5(pid=8765): Launched 01:50:48.186780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:48.717234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8767): Launched 01:50:48.835119 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:49.093549 run patchelf(pid=8768): Launched 01:50:49.265368 run osmo-stp_10.42.42.5(pid=8765): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8765)] 01:50:49.396183 run osmo-stp_10.42.42.5(pid=8765): stdout: | (launched: 2022-12-09_01:50:48.012777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:49.528611 run osmo-stp_10.42.42.5(pid=8765): stderr: | 20221209015048180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015048180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015048180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015048181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015048181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015048181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015048181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:49.661297 run osmo-stp_10.42.42.5(pid=8765): stdout: | (launched: 2022-12-09_01:50:48.012777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:49.787505 run osmo-stp_10.42.42.5(pid=8765): stderr: | 20221209015048180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015048180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015048180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015048181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015048181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015048181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015048181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:49.937575 run patchelf(pid=8768): Terminating (SIGINT) 01:50:50.110732 run patchelf(pid=8768): Terminated: ok {rc=0} 01:50:50.235662 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8765): Process ended prematurely: osmo-stp_10.42.42.5(pid=8765) [trial-2352↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8765)] [trial-2352↪gprs:nanobts+band-900↪iperf3m4.py:8] 01:50:50.245344 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:50:50.273539 run osmo-hlr_10.42.42.2(pid=8762): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8762)] 01:50:50.321649 run osmo-hlr_10.42.42.2(pid=8762): stdout: | (launched: 2022-12-09_01:50:47.003847) 01:50:50.371539 run osmo-hlr_10.42.42.2(pid=8762): stderr: | 20221209015047261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015047261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015047261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015047261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015047261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015047262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015047274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015047284 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015047284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015047284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:50.421886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8751): Terminating (SIGTERM) 01:50:50.461900 run iperf3-srv_10.42.42.10(pid=8752): Terminating (SIGTERM) 01:50:50.501746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8753): Terminating (SIGTERM) 01:50:50.541813 run iperf3-srv_10.42.42.10(pid=8754): Terminating (SIGTERM) 01:50:50.581581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8755): Terminating (SIGTERM) 01:50:50.621128 run iperf3-srv_10.42.42.10(pid=8756): Terminating (SIGTERM) 01:50:50.660880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8757): Terminating (SIGTERM) 01:50:50.701032 run iperf3-srv_10.42.42.10(pid=8758): Terminating (SIGTERM) 01:50:50.740644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8761): Terminating (SIGTERM) 01:50:50.780501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8764): Terminating (SIGTERM) 01:50:50.820146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8767): Terminating (SIGTERM) 01:50:50.860269 --- ParallelTerminationStrategy: PID 8751 died... 01:50:50.879483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8751): Terminated: ok {rc=0} 01:50:50.924146 --- ParallelTerminationStrategy: PID 8752 died... 01:50:50.942902 run iperf3-srv_10.42.42.10(pid=8752): Terminated {rc=256} 01:50:50.987774 --- ParallelTerminationStrategy: PID 8753 died... 01:50:51.006630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8753): Terminated: ok {rc=0} 01:50:51.050899 --- ParallelTerminationStrategy: PID 8754 died... 01:50:51.069333 run iperf3-srv_10.42.42.10(pid=8754): Terminated {rc=256} 01:50:51.113676 --- ParallelTerminationStrategy: PID 8755 died... 01:50:51.132293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8755): Terminated: ok {rc=0} 01:50:51.176274 --- ParallelTerminationStrategy: PID 8756 died... 01:50:51.194957 run iperf3-srv_10.42.42.10(pid=8756): Terminated {rc=256} 01:50:51.239044 --- ParallelTerminationStrategy: PID 8757 died... 01:50:51.257784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8757): Terminated: ok {rc=0} 01:50:51.301852 --- ParallelTerminationStrategy: PID 8758 died... 01:50:51.320472 run iperf3-srv_10.42.42.10(pid=8758): Terminated {rc=256} 01:50:51.364605 --- ParallelTerminationStrategy: PID 8761 died... 01:50:51.383418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8761): Terminated: ok {rc=0} 01:50:51.427871 --- ParallelTerminationStrategy: PID 8764 died... 01:50:51.446770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8764): Terminated: ok {rc=0} 01:50:51.491383 --- ParallelTerminationStrategy: PID 8767 died... 01:50:51.510223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8767): Terminated: ok {rc=0} 01:50:51.596285 bus /gobi_4: Setting Powered False 01:50:52.696115 bus /gobi_4: Setting Powered False 01:50:53.812357 bus /gobi_1: Setting Powered False 01:50:54.911449 bus /gobi_1: Setting Powered False 01:50:56.027415 bus /gobi_0: Setting Powered False 01:50:57.123998 bus /gobi_0: Setting Powered False 01:50:58.239801 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900 ping.py ---------------------------------------------- 01:50:59.343362 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:59.354758 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:50:59.403079 tst ping.py: using LAC 18238 01:50:59.523013 tst ping.py: using RAC 133 01:50:59.642216 tst ping.py: using CellId 18238 01:50:59.760594 tst ping.py: using BVCI 18239 01:50:59.870707 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:59.881478 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:59.891862 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:59.902567 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:59.913304 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:59.924060 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:59.934950 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:59.945735 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:51:00.063646 tst ping.py:19: start network... 01:51:00.265126 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:00.727769 run create_hlr_db(pid=8769): Launched 01:51:00.842993 bus /gobi_6: Setting Powered False 01:51:01.902603 run create_hlr_db(pid=8769): Terminated: ok {rc=0} 01:51:02.354020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8771): Launched 01:51:02.678084 run osmo-hlr_10.42.42.2(pid=8772): Launched 01:51:02.799516 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:03.359472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8774): Launched 01:51:03.681486 run osmo-stp_10.42.42.5(pid=8775): Launched 01:51:03.805900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:04.363681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8777): Launched 01:51:04.487000 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:04.758726 run patchelf(pid=8778): Launched 01:51:04.938985 run osmo-stp_10.42.42.5(pid=8775): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8775)] 01:51:05.075565 run osmo-stp_10.42.42.5(pid=8775): stdout: | (launched: 2022-12-09_01:51:03.622678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:05.213763 run osmo-stp_10.42.42.5(pid=8775): stderr: | 20221209015103815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015103815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015103815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015103816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015103816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015103816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015103816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:05.352594 run osmo-stp_10.42.42.5(pid=8775): stdout: | (launched: 2022-12-09_01:51:03.622678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:05.484204 run osmo-stp_10.42.42.5(pid=8775): stderr: | 20221209015103815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015103815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015103815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015103816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015103816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015103816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015103816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:05.640174 run patchelf(pid=8778): Terminating (SIGINT) 01:51:05.820535 run patchelf(pid=8778): Terminated: ok {rc=0} 01:51:05.950548 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8775): Process ended prematurely: osmo-stp_10.42.42.5(pid=8775) [trial-2352↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8775)] [trial-2352↪gprs:nanobts+band-900↪ping.py:22] 01:51:05.960055 tst ping.py:22: Test FAILED (6.6 sec) 01:51:05.989586 run osmo-hlr_10.42.42.2(pid=8772): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8772)] 01:51:06.040283 run osmo-hlr_10.42.42.2(pid=8772): stdout: | (launched: 2022-12-09_01:51:02.618897) 01:51:06.092474 run osmo-hlr_10.42.42.2(pid=8772): stderr: | 20221209015102818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015102818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015102818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015102818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015102818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015102818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015102830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015102840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015102841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015102841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:06.145212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8771): Terminating (SIGTERM) 01:51:06.187700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8774): Terminating (SIGTERM) 01:51:06.230011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8777): Terminating (SIGTERM) 01:51:06.273089 --- ParallelTerminationStrategy: PID 8771 died... 01:51:06.293601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8771): Terminated: ok {rc=0} 01:51:06.340670 --- ParallelTerminationStrategy: PID 8774 died... 01:51:06.360835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8774): Terminated: ok {rc=0} 01:51:06.407857 --- ParallelTerminationStrategy: PID 8777 died... 01:51:06.427957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8777): Terminated: ok {rc=0} 01:51:06.517327 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 01:51:07.606045 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:51:07.618008 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:51:07.669438 tst ping_idle_ping.py: using LAC 18239 01:51:07.797624 tst ping_idle_ping.py: using RAC 134 01:51:07.925716 tst ping_idle_ping.py: using CellId 18239 01:51:08.053459 tst ping_idle_ping.py: using BVCI 18240 01:51:08.172106 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:51:08.183318 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:51:08.194397 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:51:08.205406 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:51:08.216347 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:51:08.227333 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:51:08.238550 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:51:08.250139 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:51:08.364407 tst ping_idle_ping.py:24: start network... 01:51:08.582954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:09.085834 run create_hlr_db(pid=8779): Launched 01:51:09.218704 bus /gobi_6: Setting Powered False 01:51:10.283364 run create_hlr_db(pid=8779): Terminated: ok {rc=0} 01:51:10.715613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8781): Launched 01:51:11.017936 run osmo-hlr_10.42.42.2(pid=8782): Launched 01:51:11.133939 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:11.652846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8784): Launched 01:51:11.955343 run osmo-stp_10.42.42.5(pid=8785): Launched 01:51:12.071105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:12.592034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8787): Launched 01:51:12.708002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:12.962626 run patchelf(pid=8788): Launched 01:51:13.133091 run osmo-stp_10.42.42.5(pid=8785): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8785)] 01:51:13.261128 run osmo-stp_10.42.42.5(pid=8785): stdout: | (launched: 2022-12-09_01:51:11.899728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:13.390281 run osmo-stp_10.42.42.5(pid=8785): stderr: | 20221209015112068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015112068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015112068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015112069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015112069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015112069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015112069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:13.520425 run osmo-stp_10.42.42.5(pid=8785): stdout: | (launched: 2022-12-09_01:51:11.899728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:13.643686 run osmo-stp_10.42.42.5(pid=8785): stderr: | 20221209015112068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015112068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015112068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015112069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015112069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015112069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015112069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:13.789950 run patchelf(pid=8788): Terminating (SIGINT) 01:51:13.959597 run patchelf(pid=8788): Terminated: ok {rc=0} 01:51:14.082005 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8785): Process ended prematurely: osmo-stp_10.42.42.5(pid=8785) [trial-2352↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8785)] [trial-2352↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 01:51:14.091007 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:51:14.118501 run osmo-hlr_10.42.42.2(pid=8782): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8782)] 01:51:14.166552 run osmo-hlr_10.42.42.2(pid=8782): stdout: | (launched: 2022-12-09_01:51:10.962660) 01:51:14.216203 run osmo-hlr_10.42.42.2(pid=8782): stderr: | 20221209015111137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015111137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015111137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015111137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015111137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015111137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015111151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015111159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015111160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015111160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:14.266445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8781): Terminating (SIGTERM) 01:51:14.306769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8784): Terminating (SIGTERM) 01:51:14.347076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8787): Terminating (SIGTERM) 01:51:14.387445 --- ParallelTerminationStrategy: PID 8781 died... 01:51:14.406741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8781): Terminated: ok {rc=0} 01:51:14.451599 --- ParallelTerminationStrategy: PID 8784 died... 01:51:14.470434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8784): Terminated: ok {rc=0} 01:51:14.515104 --- ParallelTerminationStrategy: PID 8787 died... 01:51:14.533970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8787): Terminated: ok {rc=0} 01:51:14.620320 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 01:51:15.945427 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:51:15.955418 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:51:16.003844 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:51:16.045200 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:51:16.133052 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:51:16.168637 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:51:16.209777 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:51:16.812096 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:51:16.886354 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:16.902895 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:51:16.966249 tst cs_paging_gprs_active.py: using LAC 18240 01:51:17.098198 tst cs_paging_gprs_active.py: using RAC 135 01:51:17.228230 tst cs_paging_gprs_active.py: using CellId 18240 01:51:17.348731 tst cs_paging_gprs_active.py: using BVCI 18241 01:51:17.460046 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:17.471026 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:17.481742 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:17.493122 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:17.504020 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:17.514916 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:17.525972 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:17.536823 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:17.547841 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:17.667638 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:17.783493 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:51:17.990457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:18.299172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8793): Launched 01:51:18.567427 run iperf3-srv_10.42.42.10(pid=8794): Launched 01:51:18.683812 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:51:18.889942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:19.198941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8795): Launched 01:51:19.466965 run iperf3-srv_10.42.42.10(pid=8796): Launched 01:51:19.582300 tst cs_paging_gprs_active.py:38: start network... 01:51:19.787735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:20.263961 run create_hlr_db(pid=8797): Launched 01:51:20.383606 bus /gobi_6: Setting Powered False 01:51:21.444349 run create_hlr_db(pid=8797): Terminated: ok {rc=0} 01:51:21.893047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8799): Launched 01:51:22.223114 run osmo-hlr_10.42.42.2(pid=8800): Launched 01:51:22.349874 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:22.920446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8802): Launched 01:51:23.251418 run osmo-stp_10.42.42.5(pid=8803): Launched 01:51:23.379258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:23.947551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8805): Launched 01:51:24.075687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:24.355770 run patchelf(pid=8806): Launched 01:51:24.542682 run osmo-stp_10.42.42.5(pid=8803): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8803)] 01:51:24.682035 run osmo-stp_10.42.42.5(pid=8803): stdout: | (launched: 2022-12-09_01:51:23.191469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:24.823892 run osmo-stp_10.42.42.5(pid=8803): stderr: | 20221209015123382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015123383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015123383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015123383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015123384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015123384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015123384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:24.965284 run osmo-stp_10.42.42.5(pid=8803): stdout: | (launched: 2022-12-09_01:51:23.191469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:25.100129 run osmo-stp_10.42.42.5(pid=8803): stderr: | 20221209015123382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015123383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015123383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015123383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015123384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015123384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015123384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:25.260277 run patchelf(pid=8806): Terminating (SIGINT) 01:51:25.444579 run patchelf(pid=8806): Terminated: ok {rc=0} 01:51:25.577284 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8803): Process ended prematurely: osmo-stp_10.42.42.5(pid=8803) [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8803)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:51:25.587485 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:51:25.616249 run osmo-hlr_10.42.42.2(pid=8800): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8800)] 01:51:25.666429 run osmo-hlr_10.42.42.2(pid=8800): stdout: | (launched: 2022-12-09_01:51:22.163199) 01:51:25.718529 run osmo-hlr_10.42.42.2(pid=8800): stderr: | 20221209015122362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015122362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015122362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015122362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015122362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015122362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015122374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015122385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015122385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015122385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:25.770943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8793): Terminating (SIGTERM) 01:51:25.813003 run iperf3-srv_10.42.42.10(pid=8794): Terminating (SIGTERM) 01:51:25.854747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8795): Terminating (SIGTERM) 01:51:25.896681 run iperf3-srv_10.42.42.10(pid=8796): Terminating (SIGTERM) 01:51:25.938578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8799): Terminating (SIGTERM) 01:51:25.980559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8802): Terminating (SIGTERM) 01:51:26.022570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8805): Terminating (SIGTERM) 01:51:26.065085 --- ParallelTerminationStrategy: PID 8793 died... 01:51:26.085235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8793): Terminated: ok {rc=0} 01:51:26.132049 --- ParallelTerminationStrategy: PID 8794 died... 01:51:26.151940 run iperf3-srv_10.42.42.10(pid=8794): Terminated {rc=256} 01:51:26.198176 --- ParallelTerminationStrategy: PID 8795 died... 01:51:26.218392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8795): Terminated: ok {rc=0} 01:51:26.265477 --- ParallelTerminationStrategy: PID 8796 died... 01:51:26.285197 run iperf3-srv_10.42.42.10(pid=8796): Terminated {rc=256} 01:51:26.331571 --- ParallelTerminationStrategy: PID 8799 died... 01:51:26.351344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8799): Terminated: ok {rc=0} 01:51:26.397618 --- ParallelTerminationStrategy: PID 8802 died... 01:51:26.417486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8802): Terminated: ok {rc=0} 01:51:26.463862 --- ParallelTerminationStrategy: PID 8805 died... 01:51:26.483759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8805): Terminated: ok {rc=0} 01:51:26.572868 bus /gobi_0: Setting Powered False 01:51:27.672588 bus /gobi_0: Setting Powered False 01:51:28.789888 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:51:29.940137 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:29.952284 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:51:30.009231 tst iperf3.py: using LAC 18241 01:51:30.138375 tst iperf3.py: using RAC 136 01:51:30.268837 tst iperf3.py: using CellId 18241 01:51:30.395895 tst iperf3.py: using BVCI 18242 01:51:30.515462 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:30.527054 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:30.538486 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:30.549852 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:30.560852 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:30.572186 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:30.583902 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:30.595266 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:30.606572 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:30.725895 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:51:30.978535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:31.300350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8807): Launched 01:51:31.588780 run iperf3-srv_10.42.42.10(pid=8808): Launched 01:51:31.738384 tst iperf3.py:8: start network... 01:51:31.955032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:32.439301 run create_hlr_db(pid=8809): Launched 01:51:32.558384 bus /gobi_6: Setting Powered False 01:51:33.623199 run create_hlr_db(pid=8809): Terminated: ok {rc=0} 01:51:34.078476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8811): Launched 01:51:34.410569 run osmo-hlr_10.42.42.2(pid=8812): Launched 01:51:34.535503 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:35.104728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8814): Launched 01:51:35.433994 run osmo-stp_10.42.42.5(pid=8815): Launched 01:51:35.558801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:36.123638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8817): Launched 01:51:36.250626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:36.528942 run patchelf(pid=8818): Launched 01:51:36.713257 run osmo-stp_10.42.42.5(pid=8815): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8815)] 01:51:36.852523 run osmo-stp_10.42.42.5(pid=8815): stdout: | (launched: 2022-12-09_01:51:35.374033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:36.993242 run osmo-stp_10.42.42.5(pid=8815): stderr: | 20221209015135568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015135568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015135568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015135568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015135569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015135569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015135569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:37.134193 run osmo-stp_10.42.42.5(pid=8815): stdout: | (launched: 2022-12-09_01:51:35.374033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:37.268746 run osmo-stp_10.42.42.5(pid=8815): stderr: | 20221209015135568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015135568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015135568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015135568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015135569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015135569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015135569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:37.428200 run patchelf(pid=8818): Terminating (SIGINT) 01:51:37.612542 run patchelf(pid=8818): Terminated: ok {rc=0} 01:51:37.745478 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8815): Process ended prematurely: osmo-stp_10.42.42.5(pid=8815) [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8815)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 01:51:37.755615 tst iperf3.py:8: Test FAILED (7.9 sec) 01:51:37.784523 run osmo-hlr_10.42.42.2(pid=8812): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8812)] 01:51:37.834840 run osmo-hlr_10.42.42.2(pid=8812): stdout: | (launched: 2022-12-09_01:51:34.349781) 01:51:37.887383 run osmo-hlr_10.42.42.2(pid=8812): stderr: | 20221209015134547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015134548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015134548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015134548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015134548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015134548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015134562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015134570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015134570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015134570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:37.939775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8807): Terminating (SIGTERM) 01:51:37.981945 run iperf3-srv_10.42.42.10(pid=8808): Terminating (SIGTERM) 01:51:38.024342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8811): Terminating (SIGTERM) 01:51:38.066845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8814): Terminating (SIGTERM) 01:51:38.109241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8817): Terminating (SIGTERM) 01:51:38.152026 --- ParallelTerminationStrategy: PID 8807 died... 01:51:38.172160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8807): Terminated: ok {rc=0} 01:51:38.219811 --- ParallelTerminationStrategy: PID 8808 died... 01:51:38.239931 run iperf3-srv_10.42.42.10(pid=8808): Terminated {rc=256} 01:51:38.287135 --- ParallelTerminationStrategy: PID 8811 died... 01:51:38.307538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8811): Terminated: ok {rc=0} 01:51:38.354429 --- ParallelTerminationStrategy: PID 8814 died... 01:51:38.374372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8814): Terminated: ok {rc=0} 01:51:38.421106 --- ParallelTerminationStrategy: PID 8817 died... 01:51:38.441017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8817): Terminated: ok {rc=0} 01:51:38.529686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:51:39.681408 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:39.693785 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:51:39.744645 tst iperf3m4.py: using LAC 18242 01:51:39.868662 tst iperf3m4.py: using RAC 137 01:51:39.994081 tst iperf3m4.py: using CellId 18242 01:51:40.114545 tst iperf3m4.py: using BVCI 18243 01:51:40.228870 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.240273 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.251302 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.262835 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.274299 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.285646 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.297271 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.308597 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.320217 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:40.436660 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:40.555422 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:40.673663 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:40.789627 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:51:40.995863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:41.303904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8819): Launched 01:51:41.574520 run iperf3-srv_10.42.42.10(pid=8820): Launched 01:51:41.692423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:51:41.898414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:42.205810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8821): Launched 01:51:42.474839 run iperf3-srv_10.42.42.10(pid=8822): Launched 01:51:42.590507 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:51:42.796141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:43.104128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8823): Launched 01:51:43.371622 run iperf3-srv_10.42.42.10(pid=8824): Launched 01:51:43.487451 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:51:43.693003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:44.000616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8825): Launched 01:51:44.268350 run iperf3-srv_10.42.42.10(pid=8826): Launched 01:51:44.384120 tst iperf3m4.py:8: start network... 01:51:44.589283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:45.062584 run create_hlr_db(pid=8827): Launched 01:51:45.181694 bus /gobi_6: Setting Powered False 01:51:46.280402 run create_hlr_db(pid=8827): Terminated: ok {rc=0} 01:51:46.765451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8829): Launched 01:51:47.079493 run osmo-hlr_10.42.42.2(pid=8830): Launched 01:51:47.264070 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:47.832364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8832): Launched 01:51:48.160925 run osmo-stp_10.42.42.5(pid=8833): Launched 01:51:48.285802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:48.852040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8835): Launched 01:51:48.979134 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:49.256295 run patchelf(pid=8836): Launched 01:51:49.441222 run osmo-stp_10.42.42.5(pid=8833): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8833)] 01:51:49.579973 run osmo-stp_10.42.42.5(pid=8833): stdout: | (launched: 2022-12-09_01:51:48.100370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:49.720162 run osmo-stp_10.42.42.5(pid=8833): stderr: | 20221209015148288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015148288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015148289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015148289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015148290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015148290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015148290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:49.859901 run osmo-stp_10.42.42.5(pid=8833): stdout: | (launched: 2022-12-09_01:51:48.100370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:49.994225 run osmo-stp_10.42.42.5(pid=8833): stderr: | 20221209015148288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015148288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015148289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015148289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015148290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015148290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015148290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:50.153390 run patchelf(pid=8836): Terminating (SIGINT) 01:51:50.338023 run patchelf(pid=8836): Terminated: ok {rc=0} 01:51:50.470621 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8833): Process ended prematurely: osmo-stp_10.42.42.5(pid=8833) [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8833)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 01:51:50.480773 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:51:50.510039 run osmo-hlr_10.42.42.2(pid=8830): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8830)] 01:51:50.560337 run osmo-hlr_10.42.42.2(pid=8830): stdout: | (launched: 2022-12-09_01:51:47.022251) 01:51:50.612490 run osmo-hlr_10.42.42.2(pid=8830): stderr: | 20221209015147277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015147277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015147277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015147277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015147277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015147277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015147290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015147298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015147298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015147298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:50.664748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8819): Terminating (SIGTERM) 01:51:50.706689 run iperf3-srv_10.42.42.10(pid=8820): Terminating (SIGTERM) 01:51:50.748286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8821): Terminating (SIGTERM) 01:51:50.790210 run iperf3-srv_10.42.42.10(pid=8822): Terminating (SIGTERM) 01:51:50.831867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8823): Terminating (SIGTERM) 01:51:50.873667 run iperf3-srv_10.42.42.10(pid=8824): Terminating (SIGTERM) 01:51:50.915263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8825): Terminating (SIGTERM) 01:51:50.957363 run iperf3-srv_10.42.42.10(pid=8826): Terminating (SIGTERM) 01:51:50.999015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8829): Terminating (SIGTERM) 01:51:51.040771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8832): Terminating (SIGTERM) 01:51:51.082528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8835): Terminating (SIGTERM) 01:51:51.124536 --- ParallelTerminationStrategy: PID 8819 died... 01:51:51.144942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8819): Terminated: ok {rc=0} 01:51:51.191643 --- ParallelTerminationStrategy: PID 8820 died... 01:51:51.211448 run iperf3-srv_10.42.42.10(pid=8820): Terminated {rc=256} 01:51:51.257445 --- ParallelTerminationStrategy: PID 8821 died... 01:51:51.277315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8821): Terminated: ok {rc=0} 01:51:51.323897 --- ParallelTerminationStrategy: PID 8822 died... 01:51:51.343660 run iperf3-srv_10.42.42.10(pid=8822): Terminated {rc=256} 01:51:51.390132 --- ParallelTerminationStrategy: PID 8823 died... 01:51:51.409707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8823): Terminated: ok {rc=0} 01:51:51.456092 --- ParallelTerminationStrategy: PID 8824 died... 01:51:51.475824 run iperf3-srv_10.42.42.10(pid=8824): Terminated {rc=256} 01:51:51.521990 --- ParallelTerminationStrategy: PID 8825 died... 01:51:51.541800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8825): Terminated: ok {rc=0} 01:51:51.588320 --- ParallelTerminationStrategy: PID 8826 died... 01:51:51.608126 run iperf3-srv_10.42.42.10(pid=8826): Terminated {rc=256} 01:51:51.654378 --- ParallelTerminationStrategy: PID 8829 died... 01:51:51.674062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8829): Terminated: ok {rc=0} 01:51:51.720187 --- ParallelTerminationStrategy: PID 8832 died... 01:51:51.739874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8832): Terminated: ok {rc=0} 01:51:51.785979 --- ParallelTerminationStrategy: PID 8835 died... 01:51:51.805755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8835): Terminated: ok {rc=0} 01:51:51.894345 bus /gobi_4: Setting Powered False 01:51:52.995170 bus /gobi_4: Setting Powered False 01:51:54.112996 bus /gobi_1: Setting Powered False 01:51:55.213380 bus /gobi_1: Setting Powered False 01:51:56.332910 bus /gobi_0: Setting Powered False 01:51:57.431812 bus /gobi_0: Setting Powered False 01:51:58.548569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 01:51:59.650812 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:59.662434 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:51:59.713200 tst ping.py: using LAC 18243 01:51:59.833366 tst ping.py: using RAC 138 01:51:59.950388 tst ping.py: using CellId 18243 01:52:00.070352 tst ping.py: using BVCI 18244 01:52:00.181771 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:00.192677 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:00.203802 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:00.214935 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:00.226062 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:00.236873 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:00.247942 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:00.258847 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:52:00.371715 tst ping.py:19: start network... 01:52:00.573397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:01.038160 run create_hlr_db(pid=8837): Launched 01:52:01.189106 bus /gobi_6: Setting Powered False 01:52:02.247864 run create_hlr_db(pid=8837): Terminated: ok {rc=0} 01:52:02.670897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8839): Launched 01:52:02.971081 run osmo-hlr_10.42.42.2(pid=8840): Launched 01:52:03.085836 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:03.621681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8842): Launched 01:52:03.924130 run osmo-stp_10.42.42.5(pid=8843): Launched 01:52:04.039123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:04.558554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8845): Launched 01:52:04.683367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:04.956139 run patchelf(pid=8846): Launched 01:52:05.137437 run osmo-stp_10.42.42.5(pid=8843): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8843)] 01:52:05.274127 run osmo-stp_10.42.42.5(pid=8843): stdout: | (launched: 2022-12-09_01:52:03.868496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:05.411945 run osmo-stp_10.42.42.5(pid=8843): stderr: | 20221209015204039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015204040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015204040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015204040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015204041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015204041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015204041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:05.550392 run osmo-stp_10.42.42.5(pid=8843): stdout: | (launched: 2022-12-09_01:52:03.868496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:05.681931 run osmo-stp_10.42.42.5(pid=8843): stderr: | 20221209015204039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015204040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015204040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015204040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015204041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015204041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015204041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:05.837894 run patchelf(pid=8846): Terminating (SIGINT) 01:52:06.018104 run patchelf(pid=8846): Terminated: ok {rc=0} 01:52:06.148026 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8843): Process ended prematurely: osmo-stp_10.42.42.5(pid=8843) [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8843)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 01:52:06.157829 tst ping.py:22: Test FAILED (6.5 sec) 01:52:06.186318 run osmo-hlr_10.42.42.2(pid=8840): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8840)] 01:52:06.236690 run osmo-hlr_10.42.42.2(pid=8840): stdout: | (launched: 2022-12-09_01:52:02.915743) 01:52:06.289320 run osmo-hlr_10.42.42.2(pid=8840): stderr: | 20221209015203090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015203090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015203090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015203090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015203090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015203090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015203102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015203111 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015203111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015203111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:06.341871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8839): Terminating (SIGTERM) 01:52:06.384095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8842): Terminating (SIGTERM) 01:52:06.426418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8845): Terminating (SIGTERM) 01:52:06.469596 --- ParallelTerminationStrategy: PID 8839 died... 01:52:06.490029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8839): Terminated: ok {rc=0} 01:52:06.537284 --- ParallelTerminationStrategy: PID 8842 died... 01:52:06.557336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8842): Terminated: ok {rc=0} 01:52:06.603920 --- ParallelTerminationStrategy: PID 8845 died... 01:52:06.623805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8845): Terminated: ok {rc=0} 01:52:06.712469 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:52:07.801016 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:07.813627 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:52:07.865664 tst ping_idle_ping.py: using LAC 18244 01:52:07.986253 tst ping_idle_ping.py: using RAC 139 01:52:08.106265 tst ping_idle_ping.py: using CellId 18244 01:52:08.224740 tst ping_idle_ping.py: using BVCI 18245 01:52:08.334510 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:08.345663 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:08.356476 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:08.367454 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:08.378409 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:08.389442 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:08.400483 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:52:08.411598 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:52:08.526833 tst ping_idle_ping.py:24: start network... 01:52:08.730150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:09.199775 run create_hlr_db(pid=8847): Launched 01:52:09.315335 bus /gobi_6: Setting Powered False 01:52:10.376051 run create_hlr_db(pid=8847): Terminated: ok {rc=0} 01:52:10.821597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8849): Launched 01:52:11.148001 run osmo-hlr_10.42.42.2(pid=8850): Launched 01:52:11.272054 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:11.831690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8852): Launched 01:52:12.157295 run osmo-stp_10.42.42.5(pid=8853): Launched 01:52:12.281912 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:12.844356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8855): Launched 01:52:12.968256 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:13.242586 run patchelf(pid=8856): Launched 01:52:13.425389 run osmo-stp_10.42.42.5(pid=8853): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8853)] 01:52:13.562107 run osmo-stp_10.42.42.5(pid=8853): stdout: | (launched: 2022-12-09_01:52:12.098080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:13.700331 run osmo-stp_10.42.42.5(pid=8853): stderr: | 20221209015212290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015212290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015212290 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015212290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015212291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015212291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015212291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:13.838769 run osmo-stp_10.42.42.5(pid=8853): stdout: | (launched: 2022-12-09_01:52:12.098080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:13.970582 run osmo-stp_10.42.42.5(pid=8853): stderr: | 20221209015212290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015212290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015212290 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015212290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015212291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015212291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015212291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:14.127182 run patchelf(pid=8856): Terminating (SIGINT) 01:52:14.309176 run patchelf(pid=8856): Terminated: ok {rc=0} 01:52:14.439404 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8853): Process ended prematurely: osmo-stp_10.42.42.5(pid=8853) [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8853)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 01:52:14.448860 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:52:14.477582 run osmo-hlr_10.42.42.2(pid=8850): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8850)] 01:52:14.528808 run osmo-hlr_10.42.42.2(pid=8850): stdout: | (launched: 2022-12-09_01:52:11.088343) 01:52:14.581307 run osmo-hlr_10.42.42.2(pid=8850): stderr: | 20221209015211287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015211287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015211287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015211287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015211287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015211287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015211300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015211308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015211309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015211309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:14.633958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8849): Terminating (SIGTERM) 01:52:14.676131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8852): Terminating (SIGTERM) 01:52:14.718308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8855): Terminating (SIGTERM) 01:52:14.761048 --- ParallelTerminationStrategy: PID 8849 died... 01:52:14.781390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8849): Terminated: ok {rc=0} 01:52:14.828449 --- ParallelTerminationStrategy: PID 8852 died... 01:52:14.848412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8852): Terminated: ok {rc=0} 01:52:14.895123 --- ParallelTerminationStrategy: PID 8855 died... 01:52:14.915024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8855): Terminated: ok {rc=0} 01:52:15.003666 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:52:16.380182 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:52:16.391741 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:52:16.431816 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:52:16.483155 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:52:16.595358 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:52:16.638315 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:52:16.690588 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:52:17.275537 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:52:17.329099 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:17.340515 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:52:17.407641 tst cs_paging_gprs_active.py: using LAC 18245 01:52:17.534008 tst cs_paging_gprs_active.py: using RAC 140 01:52:17.661471 tst cs_paging_gprs_active.py: using CellId 18245 01:52:17.788608 tst cs_paging_gprs_active.py: using BVCI 18246 01:52:17.907609 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:17.919055 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:17.930297 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:17.941579 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:17.952663 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:17.963975 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:17.975275 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:17.986465 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:17.997938 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:18.121791 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:18.243742 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:52:18.466615 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:18.797115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8861): Launched 01:52:19.082689 run iperf3-srv_10.42.42.10(pid=8862): Launched 01:52:19.207697 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:52:19.429825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:19.760002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8863): Launched 01:52:20.046510 run iperf3-srv_10.42.42.10(pid=8864): Launched 01:52:20.170281 tst cs_paging_gprs_active.py:38: start network... 01:52:20.392554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:20.903206 run create_hlr_db(pid=8865): Launched 01:52:21.037256 bus /gobi_6: Setting Powered False 01:52:22.102430 run create_hlr_db(pid=8865): Terminated: ok {rc=0} 01:52:22.541263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8867): Launched 01:52:22.849663 run osmo-hlr_10.42.42.2(pid=8868): Launched 01:52:22.968021 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:23.496509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8870): Launched 01:52:23.803570 run osmo-stp_10.42.42.5(pid=8871): Launched 01:52:23.922028 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:24.451215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8873): Launched 01:52:24.571228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:24.831397 run patchelf(pid=8874): Launched 01:52:25.002980 run osmo-stp_10.42.42.5(pid=8871): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8871)] 01:52:25.133214 run osmo-stp_10.42.42.5(pid=8871): stdout: | (launched: 2022-12-09_01:52:23.747260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:25.265914 run osmo-stp_10.42.42.5(pid=8871): stderr: | 20221209015223915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015223916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015223916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015223916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015223917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015223917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015223917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:25.398379 run osmo-stp_10.42.42.5(pid=8871): stdout: | (launched: 2022-12-09_01:52:23.747260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:25.524232 run osmo-stp_10.42.42.5(pid=8871): stderr: | 20221209015223915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015223916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015223916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015223916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015223917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015223917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015223917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:25.673402 run patchelf(pid=8874): Terminating (SIGINT) 01:52:25.846624 run patchelf(pid=8874): Terminated: ok {rc=0} 01:52:25.971746 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8871): Process ended prematurely: osmo-stp_10.42.42.5(pid=8871) [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8871)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:52:25.981355 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:52:26.009411 run osmo-hlr_10.42.42.2(pid=8868): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8868)] 01:52:26.057355 run osmo-hlr_10.42.42.2(pid=8868): stdout: | (launched: 2022-12-09_01:52:22.792712) 01:52:26.107237 run osmo-hlr_10.42.42.2(pid=8868): stderr: | 20221209015222968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015222968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015222968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015222968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015222968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015222969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015222987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015222998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015222998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015222998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:26.158106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8861): Terminating (SIGTERM) 01:52:26.198125 run iperf3-srv_10.42.42.10(pid=8862): Terminating (SIGTERM) 01:52:26.238087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8863): Terminating (SIGTERM) 01:52:26.278491 run iperf3-srv_10.42.42.10(pid=8864): Terminating (SIGTERM) 01:52:26.318659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8867): Terminating (SIGTERM) 01:52:26.358783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8870): Terminating (SIGTERM) 01:52:26.398709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8873): Terminating (SIGTERM) 01:52:26.438816 --- ParallelTerminationStrategy: PID 8861 died... 01:52:26.458156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8861): Terminated: ok {rc=0} 01:52:26.502910 --- ParallelTerminationStrategy: PID 8862 died... 01:52:26.521697 run iperf3-srv_10.42.42.10(pid=8862): Terminated {rc=256} 01:52:26.565951 --- ParallelTerminationStrategy: PID 8863 died... 01:52:26.584546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8863): Terminated: ok {rc=0} 01:52:26.629287 --- ParallelTerminationStrategy: PID 8864 died... 01:52:26.648047 run iperf3-srv_10.42.42.10(pid=8864): Terminated {rc=256} 01:52:26.692277 --- ParallelTerminationStrategy: PID 8867 died... 01:52:26.711141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8867): Terminated: ok {rc=0} 01:52:26.755602 --- ParallelTerminationStrategy: PID 8870 died... 01:52:26.774479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8870): Terminated: ok {rc=0} 01:52:26.818614 --- ParallelTerminationStrategy: PID 8873 died... 01:52:26.837451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8873): Terminated: ok {rc=0} 01:52:26.922496 bus /gobi_0: Setting Powered False 01:52:28.021307 bus /gobi_0: Setting Powered False 01:52:29.134711 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:52:30.285230 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:30.297526 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:52:30.369858 tst iperf3.py: using LAC 18246 01:52:30.499899 tst iperf3.py: using RAC 141 01:52:30.628427 tst iperf3.py: using CellId 18246 01:52:30.757159 tst iperf3.py: using BVCI 18247 01:52:30.891007 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:30.910235 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:30.922078 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:30.934131 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:30.946102 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:30.958137 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:30.970230 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:30.982143 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:30.994949 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:31.274558 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:52:31.491356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:31.854071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8883): Launched 01:52:32.191927 run iperf3-srv_10.42.42.10(pid=8884): Launched 01:52:32.327440 tst iperf3.py:8: start network... 01:52:32.537880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:33.014647 run create_hlr_db(pid=8885): Launched 01:52:33.133211 bus /gobi_6: Setting Powered False 01:52:34.194762 run create_hlr_db(pid=8885): Terminated: ok {rc=0} 01:52:34.644048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8887): Launched 01:52:34.975339 run osmo-hlr_10.42.42.2(pid=8888): Launched 01:52:35.101207 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:35.670887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8890): Launched 01:52:36.001822 run osmo-stp_10.42.42.5(pid=8891): Launched 01:52:36.127576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:36.699015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8893): Launched 01:52:36.826944 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:37.104382 run patchelf(pid=8894): Launched 01:52:37.287886 run osmo-stp_10.42.42.5(pid=8891): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8891)] 01:52:37.427292 run osmo-stp_10.42.42.5(pid=8891): stdout: | (launched: 2022-12-09_01:52:35.941877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:37.568200 run osmo-stp_10.42.42.5(pid=8891): stderr: | 20221209015236133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015236134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015236134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015236134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015236135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015236135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015236135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:37.708383 run osmo-stp_10.42.42.5(pid=8891): stdout: | (launched: 2022-12-09_01:52:35.941877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:37.842402 run osmo-stp_10.42.42.5(pid=8891): stderr: | 20221209015236133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015236134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015236134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015236134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015236135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015236135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015236135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:38.001133 run patchelf(pid=8894): Terminating (SIGINT) 01:52:38.185617 run patchelf(pid=8894): Terminated: ok {rc=0} 01:52:38.319088 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8891): Process ended prematurely: osmo-stp_10.42.42.5(pid=8891) [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8891)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 01:52:38.329449 tst iperf3.py:8: Test FAILED (8.1 sec) 01:52:38.358513 run osmo-hlr_10.42.42.2(pid=8888): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8888)] 01:52:38.408537 run osmo-hlr_10.42.42.2(pid=8888): stdout: | (launched: 2022-12-09_01:52:34.915170) 01:52:38.460507 run osmo-hlr_10.42.42.2(pid=8888): stderr: | 20221209015235113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015235113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015235113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015235113 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015235113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015235113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015235125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015235134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015235134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015235134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:38.513068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8883): Terminating (SIGTERM) 01:52:38.555334 run iperf3-srv_10.42.42.10(pid=8884): Terminating (SIGTERM) 01:52:38.597733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8887): Terminating (SIGTERM) 01:52:38.640142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8890): Terminating (SIGTERM) 01:52:38.682565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8893): Terminating (SIGTERM) 01:52:38.725718 --- ParallelTerminationStrategy: PID 8883 died... 01:52:38.746079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8883): Terminated: ok {rc=0} 01:52:38.792924 --- ParallelTerminationStrategy: PID 8884 died... 01:52:38.812749 run iperf3-srv_10.42.42.10(pid=8884): Terminated {rc=256} 01:52:38.859199 --- ParallelTerminationStrategy: PID 8887 died... 01:52:38.878946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8887): Terminated: ok {rc=0} 01:52:38.925441 --- ParallelTerminationStrategy: PID 8890 died... 01:52:38.945291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8890): Terminated: ok {rc=0} 01:52:38.991856 --- ParallelTerminationStrategy: PID 8893 died... 01:52:39.011729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8893): Terminated: ok {rc=0} 01:52:39.100458 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:52:40.252224 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:40.264447 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:52:40.333632 tst iperf3m4.py: using LAC 18247 01:52:40.463916 tst iperf3m4.py: using RAC 142 01:52:40.587847 tst iperf3m4.py: using CellId 18247 01:52:40.708562 tst iperf3m4.py: using BVCI 18248 01:52:40.823642 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:40.834789 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:40.845716 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:40.856769 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:40.867674 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:40.878590 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:40.889758 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:40.900495 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:40.911558 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:41.032377 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:41.156530 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:41.278372 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:41.398100 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:52:41.620599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:41.950798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8895): Launched 01:52:42.238138 run iperf3-srv_10.42.42.10(pid=8896): Launched 01:52:42.364035 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:52:42.586849 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:42.918558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8897): Launched 01:52:43.205385 run iperf3-srv_10.42.42.10(pid=8898): Launched 01:52:43.331388 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:52:43.554986 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:43.886896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8899): Launched 01:52:44.174850 run iperf3-srv_10.42.42.10(pid=8900): Launched 01:52:44.300251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:52:44.523151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:44.854732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8901): Launched 01:52:45.141640 run iperf3-srv_10.42.42.10(pid=8902): Launched 01:52:45.267615 tst iperf3m4.py:8: start network... 01:52:45.491628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:45.997582 run create_hlr_db(pid=8903): Launched 01:52:46.202038 bus /gobi_6: Setting Powered False 01:52:47.278318 run create_hlr_db(pid=8903): Terminated: ok {rc=0} 01:52:47.758455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8905): Launched 01:52:48.088786 run osmo-hlr_10.42.42.2(pid=8906): Launched 01:52:48.213661 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:48.783893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8908): Launched 01:52:49.113183 run osmo-stp_10.42.42.5(pid=8909): Launched 01:52:49.239332 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:49.806460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8911): Launched 01:52:49.933718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:50.211316 run patchelf(pid=8912): Launched 01:52:50.396073 run osmo-stp_10.42.42.5(pid=8909): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8909)] 01:52:50.535421 run osmo-stp_10.42.42.5(pid=8909): stdout: | (launched: 2022-12-09_01:52:49.053090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:50.676008 run osmo-stp_10.42.42.5(pid=8909): stderr: | 20221209015249242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015249243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015249243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015249243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015249244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015249244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015249244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:50.816841 run osmo-stp_10.42.42.5(pid=8909): stdout: | (launched: 2022-12-09_01:52:49.053090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:50.950973 run osmo-stp_10.42.42.5(pid=8909): stderr: | 20221209015249242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015249243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015249243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015249243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015249244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015249244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015249244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:51.110135 run patchelf(pid=8912): Terminating (SIGINT) 01:52:51.294525 run patchelf(pid=8912): Terminated: ok {rc=0} 01:52:51.427446 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8909): Process ended prematurely: osmo-stp_10.42.42.5(pid=8909) [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8909)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:52:51.438280 tst iperf3m4.py:8: Test FAILED (11.2 sec) 01:52:51.467268 run osmo-hlr_10.42.42.2(pid=8906): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8906)] 01:52:51.517919 run osmo-hlr_10.42.42.2(pid=8906): stdout: | (launched: 2022-12-09_01:52:48.028852) 01:52:51.569711 run osmo-hlr_10.42.42.2(pid=8906): stderr: | 20221209015248226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015248226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015248226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015248226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015248226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015248226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015248243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015248253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015248253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015248253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:51.621802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8895): Terminating (SIGTERM) 01:52:51.663778 run iperf3-srv_10.42.42.10(pid=8896): Terminating (SIGTERM) 01:52:51.705731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8897): Terminating (SIGTERM) 01:52:51.747636 run iperf3-srv_10.42.42.10(pid=8898): Terminating (SIGTERM) 01:52:51.789287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8899): Terminating (SIGTERM) 01:52:51.831045 run iperf3-srv_10.42.42.10(pid=8900): Terminating (SIGTERM) 01:52:51.872753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8901): Terminating (SIGTERM) 01:52:51.914833 run iperf3-srv_10.42.42.10(pid=8902): Terminating (SIGTERM) 01:52:51.956515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8905): Terminating (SIGTERM) 01:52:51.998505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8908): Terminating (SIGTERM) 01:52:52.040377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8911): Terminating (SIGTERM) 01:52:52.082769 --- ParallelTerminationStrategy: PID 8895 died... 01:52:52.102990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8895): Terminated: ok {rc=0} 01:52:52.149325 --- ParallelTerminationStrategy: PID 8896 died... 01:52:52.168894 run iperf3-srv_10.42.42.10(pid=8896): Terminated {rc=256} 01:52:52.215177 --- ParallelTerminationStrategy: PID 8897 died... 01:52:52.234897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8897): Terminated: ok {rc=0} 01:52:52.281250 --- ParallelTerminationStrategy: PID 8898 died... 01:52:52.301211 run iperf3-srv_10.42.42.10(pid=8898): Terminated {rc=256} 01:52:52.347561 --- ParallelTerminationStrategy: PID 8899 died... 01:52:52.367192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8899): Terminated: ok {rc=0} 01:52:52.413470 --- ParallelTerminationStrategy: PID 8900 died... 01:52:52.433206 run iperf3-srv_10.42.42.10(pid=8900): Terminated {rc=256} 01:52:52.479359 --- ParallelTerminationStrategy: PID 8901 died... 01:52:52.499079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8901): Terminated: ok {rc=0} 01:52:52.545372 --- ParallelTerminationStrategy: PID 8902 died... 01:52:52.564917 run iperf3-srv_10.42.42.10(pid=8902): Terminated {rc=256} 01:52:52.611156 --- ParallelTerminationStrategy: PID 8905 died... 01:52:52.630888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8905): Terminated: ok {rc=0} 01:52:52.677118 --- ParallelTerminationStrategy: PID 8908 died... 01:52:52.696748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8908): Terminated: ok {rc=0} 01:52:52.743093 --- ParallelTerminationStrategy: PID 8911 died... 01:52:52.762791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8911): Terminated: ok {rc=0} 01:52:52.851797 bus /gobi_4: Setting Powered False 01:52:53.953036 bus /gobi_4: Setting Powered False 01:52:55.070209 bus /gobi_1: Setting Powered False 01:52:56.168929 bus /gobi_1: Setting Powered False 01:52:57.283315 bus /gobi_0: Setting Powered False 01:52:58.381707 bus /gobi_0: Setting Powered False 01:52:59.498782 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:53:00.602334 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:00.614353 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:53:00.683819 tst ping.py: using LAC 18248 01:53:00.809364 tst ping.py: using RAC 143 01:53:00.946447 tst ping.py: using CellId 18248 01:53:01.073246 tst ping.py: using BVCI 18249 01:53:01.226456 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:01.239664 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:01.251662 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:01.263625 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:01.275660 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:01.293542 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:01.309616 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:01.322024 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:53:01.462293 tst ping.py:19: start network... 01:53:01.716391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:02.245829 run create_hlr_db(pid=8961): Launched 01:53:02.420076 bus /gobi_6: Setting Powered False 01:53:03.508383 run create_hlr_db(pid=8961): Terminated: ok {rc=0} 01:53:04.066080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9173): Launched 01:53:04.493698 run osmo-hlr_10.42.42.2(pid=9185): Launched 01:53:04.727668 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:05.437690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9187): Launched 01:53:05.763745 run osmo-stp_10.42.42.5(pid=9188): Launched 01:53:06.009146 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:06.696128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9192): Launched 01:53:06.831516 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:07.114859 run patchelf(pid=9193): Launched 01:53:07.309982 run osmo-stp_10.42.42.5(pid=9188): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9188)] 01:53:07.449232 run osmo-stp_10.42.42.5(pid=9188): stdout: | (launched: 2022-12-09_01:53:05.702710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:07.589855 run osmo-stp_10.42.42.5(pid=9188): stderr: | 20221209015306029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015306029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015306029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015306030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015306030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015306030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015306030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:07.730905 run osmo-stp_10.42.42.5(pid=9188): stdout: | (launched: 2022-12-09_01:53:05.702710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:07.866050 run osmo-stp_10.42.42.5(pid=9188): stderr: | 20221209015306029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015306029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015306029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015306030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015306030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015306030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015306030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:08.025694 run patchelf(pid=9193): Terminating (SIGINT) 01:53:08.209187 run patchelf(pid=9193): Terminated: ok {rc=0} 01:53:08.342113 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9188): Process ended prematurely: osmo-stp_10.42.42.5(pid=9188) [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9188)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 01:53:08.352909 tst ping.py:22: Test FAILED (7.7 sec) 01:53:08.382726 run osmo-hlr_10.42.42.2(pid=9185): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9185)] 01:53:08.434155 run osmo-hlr_10.42.42.2(pid=9185): stdout: | (launched: 2022-12-09_01:53:04.430470) 01:53:08.487607 run osmo-hlr_10.42.42.2(pid=9185): stderr: | 20221209015304762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015304762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015304762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015304762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015304762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015304762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015304777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015304790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015304790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015304790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:08.541086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9173): Terminating (SIGTERM) 01:53:08.584570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9187): Terminating (SIGTERM) 01:53:08.630232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9192): Terminating (SIGTERM) 01:53:08.675955 --- ParallelTerminationStrategy: PID 9173 died... 01:53:08.697458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9173): Terminated: ok {rc=0} 01:53:08.746968 --- ParallelTerminationStrategy: PID 9187 died... 01:53:08.767642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9187): Terminated: ok {rc=0} 01:53:08.815707 --- ParallelTerminationStrategy: PID 9192 died... 01:53:08.836522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9192): Terminated: ok {rc=0} 01:53:08.927342 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:53:10.018774 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:10.031402 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:53:10.100817 tst ping_idle_ping.py: using LAC 18249 01:53:10.230340 tst ping_idle_ping.py: using RAC 144 01:53:10.360095 tst ping_idle_ping.py: using CellId 18249 01:53:10.489534 tst ping_idle_ping.py: using BVCI 18250 01:53:10.611328 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:10.623747 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:10.637427 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:10.649801 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:10.662030 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:10.674818 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:10.687754 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:53:10.700270 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:53:10.822935 tst ping_idle_ping.py:24: start network... 01:53:11.050930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:11.572113 run create_hlr_db(pid=9194): Launched 01:53:11.743245 bus /gobi_6: Setting Powered False 01:53:12.808104 run create_hlr_db(pid=9194): Terminated: ok {rc=0} 01:53:13.276389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9196): Launched 01:53:13.621033 run osmo-hlr_10.42.42.2(pid=9197): Launched 01:53:13.874361 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:14.547800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9199): Launched 01:53:14.894159 run osmo-stp_10.42.42.5(pid=9200): Launched 01:53:15.140202 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:15.791373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9202): Launched 01:53:15.952514 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:16.239527 run patchelf(pid=9203): Launched 01:53:16.439503 run osmo-stp_10.42.42.5(pid=9200): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9200)] 01:53:16.581144 run osmo-stp_10.42.42.5(pid=9200): stdout: | (launched: 2022-12-09_01:53:14.834525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:16.723816 run osmo-stp_10.42.42.5(pid=9200): stderr: | 20221209015315128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015315128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015315128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015315129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015315129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015315129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015315130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:16.868241 run osmo-stp_10.42.42.5(pid=9200): stdout: | (launched: 2022-12-09_01:53:14.834525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:17.003768 run osmo-stp_10.42.42.5(pid=9200): stderr: | 20221209015315128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015315128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015315128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015315129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015315129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015315129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015315130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:17.167705 run patchelf(pid=9203): Terminating (SIGINT) 01:53:17.356348 run patchelf(pid=9203): Terminated: ok {rc=0} 01:53:17.491046 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9200): Process ended prematurely: osmo-stp_10.42.42.5(pid=9200) [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9200)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:53:17.501375 tst ping_idle_ping.py:27: Test FAILED (7.5 sec) 01:53:17.531094 run osmo-hlr_10.42.42.2(pid=9197): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9197)] 01:53:17.583469 run osmo-hlr_10.42.42.2(pid=9197): stdout: | (launched: 2022-12-09_01:53:13.561439) 01:53:17.637517 run osmo-hlr_10.42.42.2(pid=9197): stderr: | 20221209015313863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015313863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015313863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015313863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015313863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015313863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015313883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015313900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015313900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015313900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:17.692099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9196): Terminating (SIGTERM) 01:53:17.736000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9199): Terminating (SIGTERM) 01:53:17.782043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9202): Terminating (SIGTERM) 01:53:17.827692 --- ParallelTerminationStrategy: PID 9196 died... 01:53:17.849658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9196): Terminated: ok {rc=0} 01:53:17.898564 --- ParallelTerminationStrategy: PID 9199 died... 01:53:17.919333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9199): Terminated: ok {rc=0} 01:53:17.967123 --- ParallelTerminationStrategy: PID 9202 died... 01:53:17.987335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9202): Terminated: ok {rc=0} 01:53:18.087115 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:53:19.415151 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:53:19.424026 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:53:19.459847 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 01:53:19.500381 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 01:53:19.589996 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:53:19.624050 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 01:53:19.665691 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 01:53:20.268580 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 01:53:20.323219 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:20.336364 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:53:20.388510 tst cs_paging_gprs_active.py: using LAC 18250 01:53:20.518737 tst cs_paging_gprs_active.py: using RAC 145 01:53:20.648703 tst cs_paging_gprs_active.py: using CellId 18250 01:53:20.778408 tst cs_paging_gprs_active.py: using BVCI 18251 01:53:20.901853 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:20.914625 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:20.927659 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:20.941628 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:20.954911 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:20.967404 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:20.980750 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:20.994235 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:21.006945 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:21.134282 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:21.258329 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:53:21.485593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:21.819481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9207): Launched 01:53:22.119885 run iperf3-srv_10.42.42.10(pid=9208): Launched 01:53:22.262312 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:53:22.487718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:22.823710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9209): Launched 01:53:23.124533 run iperf3-srv_10.42.42.10(pid=9210): Launched 01:53:23.263459 tst cs_paging_gprs_active.py:38: start network... 01:53:23.488582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:24.007260 run create_hlr_db(pid=9211): Launched 01:53:24.178136 bus /gobi_6: Setting Powered False 01:53:25.246194 run create_hlr_db(pid=9211): Terminated: ok {rc=0} 01:53:25.712427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9213): Launched 01:53:26.058397 run osmo-hlr_10.42.42.2(pid=9214): Launched 01:53:26.315364 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:26.924509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9217): Launched 01:53:27.228202 run osmo-stp_10.42.42.5(pid=9218): Launched 01:53:27.344887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:27.871942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9220): Launched 01:53:27.988518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:28.244356 run patchelf(pid=9221): Launched 01:53:28.413922 run osmo-stp_10.42.42.5(pid=9218): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9218)] 01:53:28.542515 run osmo-stp_10.42.42.5(pid=9218): stdout: | (launched: 2022-12-09_01:53:27.173072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:28.673321 run osmo-stp_10.42.42.5(pid=9218): stderr: | 20221209015327342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015327342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015327342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015327343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015327344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015327344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015327344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:28.804258 run osmo-stp_10.42.42.5(pid=9218): stdout: | (launched: 2022-12-09_01:53:27.173072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:28.928736 run osmo-stp_10.42.42.5(pid=9218): stderr: | 20221209015327342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015327342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015327342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015327343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015327344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015327344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015327344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:29.075517 run patchelf(pid=9221): Terminating (SIGINT) 01:53:29.246524 run patchelf(pid=9221): Terminated: ok {rc=0} 01:53:29.370407 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9218): Process ended prematurely: osmo-stp_10.42.42.5(pid=9218) [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9218)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 01:53:29.380059 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 01:53:29.407579 run osmo-hlr_10.42.42.2(pid=9214): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9214)] 01:53:29.455986 run osmo-hlr_10.42.42.2(pid=9214): stdout: | (launched: 2022-12-09_01:53:25.997869) 01:53:29.505845 run osmo-hlr_10.42.42.2(pid=9214): stderr: | 20221209015326310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015326310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015326310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015326310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015326311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015326311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015326326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015326339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015326339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015326339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:29.555962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9207): Terminating (SIGTERM) 01:53:29.596478 run iperf3-srv_10.42.42.10(pid=9208): Terminating (SIGTERM) 01:53:29.636445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9209): Terminating (SIGTERM) 01:53:29.676468 run iperf3-srv_10.42.42.10(pid=9210): Terminating (SIGTERM) 01:53:29.716267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9213): Terminating (SIGTERM) 01:53:29.756198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9217): Terminating (SIGTERM) 01:53:29.796229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9220): Terminating (SIGTERM) 01:53:29.836415 --- ParallelTerminationStrategy: PID 9207 died... 01:53:29.855410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9207): Terminated: ok {rc=0} 01:53:29.900063 --- ParallelTerminationStrategy: PID 9208 died... 01:53:29.918684 run iperf3-srv_10.42.42.10(pid=9208): Terminated {rc=256} 01:53:29.962954 --- ParallelTerminationStrategy: PID 9209 died... 01:53:29.981461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9209): Terminated: ok {rc=0} 01:53:30.025822 --- ParallelTerminationStrategy: PID 9210 died... 01:53:30.044302 run iperf3-srv_10.42.42.10(pid=9210): Terminated {rc=256} 01:53:30.088853 --- ParallelTerminationStrategy: PID 9213 died... 01:53:30.107834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9213): Terminated: ok {rc=0} 01:53:30.152023 --- ParallelTerminationStrategy: PID 9217 died... 01:53:30.170626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9217): Terminated: ok {rc=0} 01:53:30.214839 --- ParallelTerminationStrategy: PID 9220 died... 01:53:30.233426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9220): Terminated: ok {rc=0} 01:53:30.319821 bus /gobi_0: Setting Powered False 01:53:31.421055 bus /gobi_0: Setting Powered False 01:53:32.553548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 01:53:33.699361 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:33.711412 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:53:33.762387 tst iperf3.py: using LAC 18251 01:53:33.882734 tst iperf3.py: using RAC 146 01:53:34.002538 tst iperf3.py: using CellId 18251 01:53:34.122662 tst iperf3.py: using BVCI 18252 01:53:34.234357 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:34.245874 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:34.257111 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:34.268431 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:34.279889 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:34.291307 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:34.302810 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:34.314178 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:34.325829 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:34.443200 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:53:34.645463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:34.947923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9222): Launched 01:53:35.214882 run iperf3-srv_10.42.42.10(pid=9223): Launched 01:53:35.328680 tst iperf3.py:8: start network... 01:53:35.530631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:36.001295 run create_hlr_db(pid=9224): Launched 01:53:36.118474 bus /gobi_6: Setting Powered False 01:53:37.178802 run create_hlr_db(pid=9224): Terminated: ok {rc=0} 01:53:37.599970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9226): Launched 01:53:37.902459 run osmo-hlr_10.42.42.2(pid=9227): Launched 01:53:38.018773 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:38.540773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9229): Launched 01:53:38.843993 run osmo-stp_10.42.42.5(pid=9230): Launched 01:53:38.960530 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:39.484406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9232): Launched 01:53:39.600523 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:39.856299 run patchelf(pid=9233): Launched 01:53:40.025379 run osmo-stp_10.42.42.5(pid=9230): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9230)] 01:53:40.154712 run osmo-stp_10.42.42.5(pid=9230): stdout: | (launched: 2022-12-09_01:53:38.788048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:40.284905 run osmo-stp_10.42.42.5(pid=9230): stderr: | 20221209015338958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015338959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015338959 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015338959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015338960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015338960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015338960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:40.415249 run osmo-stp_10.42.42.5(pid=9230): stdout: | (launched: 2022-12-09_01:53:38.788048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:40.539446 run osmo-stp_10.42.42.5(pid=9230): stderr: | 20221209015338958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015338959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015338959 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015338959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015338960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015338960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015338960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:40.686619 run patchelf(pid=9233): Terminating (SIGINT) 01:53:40.856737 run patchelf(pid=9233): Terminated: ok {rc=0} 01:53:40.980111 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9230): Process ended prematurely: osmo-stp_10.42.42.5(pid=9230) [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9230)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 01:53:40.989769 tst iperf3.py:8: Test FAILED (7.3 sec) 01:53:41.017588 run osmo-hlr_10.42.42.2(pid=9227): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9227)] 01:53:41.065853 run osmo-hlr_10.42.42.2(pid=9227): stdout: | (launched: 2022-12-09_01:53:37.847249) 01:53:41.115709 run osmo-hlr_10.42.42.2(pid=9227): stderr: | 20221209015338020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015338021 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015338021 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015338021 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015338021 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015338021 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015338034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015338043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015338043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015338043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:41.166207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9222): Terminating (SIGTERM) 01:53:41.206699 run iperf3-srv_10.42.42.10(pid=9223): Terminating (SIGTERM) 01:53:41.246943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9226): Terminating (SIGTERM) 01:53:41.287185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9229): Terminating (SIGTERM) 01:53:41.327395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9232): Terminating (SIGTERM) 01:53:41.367589 --- ParallelTerminationStrategy: PID 9222 died... 01:53:41.386671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9222): Terminated: ok {rc=0} 01:53:41.431938 --- ParallelTerminationStrategy: PID 9223 died... 01:53:41.450446 run iperf3-srv_10.42.42.10(pid=9223): Terminated {rc=256} 01:53:41.495164 --- ParallelTerminationStrategy: PID 9226 died... 01:53:41.513657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9226): Terminated: ok {rc=0} 01:53:41.557813 --- ParallelTerminationStrategy: PID 9229 died... 01:53:41.576339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9229): Terminated: ok {rc=0} 01:53:41.620590 --- ParallelTerminationStrategy: PID 9232 died... 01:53:41.639109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9232): Terminated: ok {rc=0} 01:53:41.723318 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 01:53:42.872015 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:42.884527 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:53:42.943252 tst iperf3m4.py: using LAC 18252 01:53:43.070402 tst iperf3m4.py: using RAC 147 01:53:43.195213 tst iperf3m4.py: using CellId 18252 01:53:43.315617 tst iperf3m4.py: using BVCI 18253 01:53:43.425511 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:43.436764 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:43.448398 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:43.459771 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:43.471070 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:43.482492 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:43.494008 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:43.505283 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:43.516773 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:43.636126 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:43.760684 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:43.877549 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:43.993231 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:53:44.197783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:44.501947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9235): Launched 01:53:44.765741 run iperf3-srv_10.42.42.10(pid=9236): Launched 01:53:44.880124 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:53:45.083727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:45.389550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9237): Launched 01:53:45.653822 run iperf3-srv_10.42.42.10(pid=9238): Launched 01:53:45.769771 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:53:45.982066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:46.293710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9239): Launched 01:53:46.593740 run iperf3-srv_10.42.42.10(pid=9240): Launched 01:53:46.732834 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:53:46.958207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:47.291181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9241): Launched 01:53:47.575745 run iperf3-srv_10.42.42.10(pid=9242): Launched 01:53:47.699046 tst iperf3m4.py:8: start network... 01:53:47.918872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:48.424685 run create_hlr_db(pid=9243): Launched 01:53:48.557406 bus /gobi_6: Setting Powered False 01:53:49.621812 run create_hlr_db(pid=9243): Terminated: ok {rc=0} 01:53:50.073193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9245): Launched 01:53:50.398965 run osmo-hlr_10.42.42.2(pid=9246): Launched 01:53:50.522433 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:51.077621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9248): Launched 01:53:51.403275 run osmo-stp_10.42.42.5(pid=9249): Launched 01:53:51.527319 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:52.087005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9251): Launched 01:53:52.211458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:52.486343 run patchelf(pid=9252): Launched 01:53:52.666841 run osmo-stp_10.42.42.5(pid=9249): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9249)] 01:53:52.804113 run osmo-stp_10.42.42.5(pid=9249): stdout: | (launched: 2022-12-09_01:53:51.344038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:52.943522 run osmo-stp_10.42.42.5(pid=9249): stderr: | 20221209015351534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015351534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015351534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015351534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015351535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015351535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015351535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:53.082652 run osmo-stp_10.42.42.5(pid=9249): stdout: | (launched: 2022-12-09_01:53:51.344038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:53.215366 run osmo-stp_10.42.42.5(pid=9249): stderr: | 20221209015351534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015351534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015351534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015351534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015351535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015351535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015351535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:53.373816 run patchelf(pid=9252): Terminating (SIGINT) 01:53:53.555497 run patchelf(pid=9252): Terminated: ok {rc=0} 01:53:53.686590 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9249): Process ended prematurely: osmo-stp_10.42.42.5(pid=9249) [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9249)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 01:53:53.696750 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:53:53.725567 run osmo-hlr_10.42.42.2(pid=9246): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9246)] 01:53:53.775548 run osmo-hlr_10.42.42.2(pid=9246): stdout: | (launched: 2022-12-09_01:53:50.339593) 01:53:53.827020 run osmo-hlr_10.42.42.2(pid=9246): stderr: | 20221209015350536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015350536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015350536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015350536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015350536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015350536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015350549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015350557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015350558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015350558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:53.879511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9235): Terminating (SIGTERM) 01:53:53.921239 run iperf3-srv_10.42.42.10(pid=9236): Terminating (SIGTERM) 01:53:53.962966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9237): Terminating (SIGTERM) 01:53:54.004788 run iperf3-srv_10.42.42.10(pid=9238): Terminating (SIGTERM) 01:53:54.046528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9239): Terminating (SIGTERM) 01:53:54.088256 run iperf3-srv_10.42.42.10(pid=9240): Terminating (SIGTERM) 01:53:54.130025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9241): Terminating (SIGTERM) 01:53:54.171733 run iperf3-srv_10.42.42.10(pid=9242): Terminating (SIGTERM) 01:53:54.213313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9245): Terminating (SIGTERM) 01:53:54.255067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9248): Terminating (SIGTERM) 01:53:54.296742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9251): Terminating (SIGTERM) 01:53:54.339226 --- ParallelTerminationStrategy: PID 9235 died... 01:53:54.359286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9235): Terminated: ok {rc=0} 01:53:54.405639 --- ParallelTerminationStrategy: PID 9236 died... 01:53:54.425087 run iperf3-srv_10.42.42.10(pid=9236): Terminated {rc=256} 01:53:54.471018 --- ParallelTerminationStrategy: PID 9237 died... 01:53:54.490577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9237): Terminated: ok {rc=0} 01:53:54.536819 --- ParallelTerminationStrategy: PID 9238 died... 01:53:54.556782 run iperf3-srv_10.42.42.10(pid=9238): Terminated {rc=256} 01:53:54.602900 --- ParallelTerminationStrategy: PID 9239 died... 01:53:54.622540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9239): Terminated: ok {rc=0} 01:53:54.668849 --- ParallelTerminationStrategy: PID 9240 died... 01:53:54.688813 run iperf3-srv_10.42.42.10(pid=9240): Terminated {rc=256} 01:53:54.735135 --- ParallelTerminationStrategy: PID 9241 died... 01:53:54.754867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9241): Terminated: ok {rc=0} 01:53:54.800937 --- ParallelTerminationStrategy: PID 9242 died... 01:53:54.820515 run iperf3-srv_10.42.42.10(pid=9242): Terminated {rc=256} 01:53:54.866603 --- ParallelTerminationStrategy: PID 9245 died... 01:53:54.886280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9245): Terminated: ok {rc=0} 01:53:54.932467 --- ParallelTerminationStrategy: PID 9248 died... 01:53:54.952109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9248): Terminated: ok {rc=0} 01:53:54.998204 --- ParallelTerminationStrategy: PID 9251 died... 01:53:55.017820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9251): Terminated: ok {rc=0} 01:53:55.105778 bus /gobi_4: Setting Powered False 01:53:56.204715 bus /gobi_4: Setting Powered False 01:53:57.319552 bus /gobi_1: Setting Powered False 01:53:58.418448 bus /gobi_1: Setting Powered False 01:53:59.533965 bus /gobi_0: Setting Powered False 01:54:00.631955 bus /gobi_0: Setting Powered False 01:54:01.750205 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 01:54:02.852313 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:02.864333 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:54:02.914596 tst ping.py: using LAC 18253 01:54:03.033274 tst ping.py: using RAC 148 01:54:03.149396 tst ping.py: using CellId 18253 01:54:03.266341 tst ping.py: using BVCI 18254 01:54:03.374573 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:03.386190 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:03.397445 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:03.408751 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:03.420423 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:03.431833 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:03.443251 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:03.454554 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:54:03.571182 tst ping.py:19: start network... 01:54:03.787457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:04.280449 run create_hlr_db(pid=9253): Launched 01:54:04.411313 bus /gobi_6: Setting Powered False 01:54:05.474431 run create_hlr_db(pid=9253): Terminated: ok {rc=0} 01:54:05.900625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9255): Launched 01:54:06.200214 run osmo-hlr_10.42.42.2(pid=9256): Launched 01:54:06.314659 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:06.845135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9258): Launched 01:54:07.143231 run osmo-stp_10.42.42.5(pid=9259): Launched 01:54:07.257930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:54:07.774118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9261): Launched 01:54:07.888397 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:54:08.140440 run patchelf(pid=9262): Launched 01:54:08.306885 run osmo-stp_10.42.42.5(pid=9259): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9259)] 01:54:08.433838 run osmo-stp_10.42.42.5(pid=9259): stdout: | (launched: 2022-12-09_01:54:07.088108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:08.562398 run osmo-stp_10.42.42.5(pid=9259): stderr: | 20221209015407257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015407257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015407257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015407258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015407258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015407258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015407258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:08.690914 run osmo-stp_10.42.42.5(pid=9259): stdout: | (launched: 2022-12-09_01:54:07.088108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:08.813813 run osmo-stp_10.42.42.5(pid=9259): stderr: | 20221209015407257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015407257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015407257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015407258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015407258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015407258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015407258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:08.958680 run patchelf(pid=9262): Terminating (SIGINT) 01:54:09.125709 run patchelf(pid=9262): Terminated: ok {rc=0} 01:54:09.246397 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9259): Process ended prematurely: osmo-stp_10.42.42.5(pid=9259) [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9259)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 01:54:09.255434 tst ping.py:22: Test FAILED (6.4 sec) 01:54:09.282707 run osmo-hlr_10.42.42.2(pid=9256): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9256)] 01:54:09.330286 run osmo-hlr_10.42.42.2(pid=9256): stdout: | (launched: 2022-12-09_01:54:06.145222) 01:54:09.379774 run osmo-hlr_10.42.42.2(pid=9256): stderr: | 20221209015406322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015406322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015406322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015406322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015406322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015406322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015406334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015406343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015406343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015406343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:09.429960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9255): Terminating (SIGTERM) 01:54:09.469678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9258): Terminating (SIGTERM) 01:54:09.509454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9261): Terminating (SIGTERM) 01:54:09.549453 --- ParallelTerminationStrategy: PID 9255 died... 01:54:09.568324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9255): Terminated: ok {rc=0} 01:54:09.613173 --- ParallelTerminationStrategy: PID 9258 died... 01:54:09.631711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9258): Terminated: ok {rc=0} 01:54:09.676052 --- ParallelTerminationStrategy: PID 9261 died... 01:54:09.694657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9261): Terminated: ok {rc=0} 01:54:09.777965 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 01:54:10.865407 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:10.878546 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:54:10.933175 tst ping_idle_ping.py: using LAC 18254 01:54:11.063732 tst ping_idle_ping.py: using RAC 149 01:54:11.188727 tst ping_idle_ping.py: using CellId 18254 01:54:11.314721 tst ping_idle_ping.py: using BVCI 18255 01:54:11.431239 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:11.443601 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:11.455469 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:11.467800 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:11.480015 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:11.492235 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:11.504472 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:54:11.516671 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:54:11.634218 tst ping_idle_ping.py:24: start network... 01:54:11.836102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:12.301562 run create_hlr_db(pid=9263): Launched 01:54:12.416750 bus /gobi_6: Setting Powered False 01:54:13.476218 run create_hlr_db(pid=9263): Terminated: ok {rc=0} 01:54:13.895358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9265): Launched 01:54:14.195365 run osmo-hlr_10.42.42.2(pid=9266): Launched 01:54:14.310639 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:14.842743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9268): Launched 01:54:15.142528 run osmo-stp_10.42.42.5(pid=9269): Launched 01:54:15.257669 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:54:15.775909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9271): Launched 01:54:15.902282 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:54:16.176221 run patchelf(pid=9272): Launched 01:54:16.361412 run osmo-stp_10.42.42.5(pid=9269): ERR: Terminated: ERROR {rc=1} [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9269)] 01:54:16.495691 run osmo-stp_10.42.42.5(pid=9269): stdout: | (launched: 2022-12-09_01:54:15.087639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:16.638579 run osmo-stp_10.42.42.5(pid=9269): stderr: | 20221209015415257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015415257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015415258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015415258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015415259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015415259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015415259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:16.780630 run osmo-stp_10.42.42.5(pid=9269): stdout: | (launched: 2022-12-09_01:54:15.087639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:16.916180 run osmo-stp_10.42.42.5(pid=9269): stderr: | 20221209015415257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015415257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015415258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015415258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015415259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015415259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015415259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:17.076021 run patchelf(pid=9272): Terminating (SIGINT) 01:54:17.257161 run patchelf(pid=9272): Terminated: ok {rc=0} 01:54:17.387727 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9269): Process ended prematurely: osmo-stp_10.42.42.5(pid=9269) [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9269)] [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 01:54:17.397709 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:54:17.426579 run osmo-hlr_10.42.42.2(pid=9266): ERR: Terminated: ERROR {rc=237} [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9266)] 01:54:17.478368 run osmo-hlr_10.42.42.2(pid=9266): stdout: | (launched: 2022-12-09_01:54:14.140586) 01:54:17.532503 run osmo-hlr_10.42.42.2(pid=9266): stderr: | 20221209015414316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015414316 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015414316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015414316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015414316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015414316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015414328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015414336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015414336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015414336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:17.586002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9265): Terminating (SIGTERM) 01:54:17.629157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9268): Terminating (SIGTERM) 01:54:17.672145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9271): Terminating (SIGTERM) 01:54:17.715328 --- ParallelTerminationStrategy: PID 9265 died... 01:54:17.735485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9265): Terminated: ok {rc=0} 01:54:17.783712 --- ParallelTerminationStrategy: PID 9268 died... 01:54:17.803545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9268): Terminated: ok {rc=0} 01:54:17.851407 --- ParallelTerminationStrategy: PID 9271 died... 01:54:17.871277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9271): Terminated: ok {rc=0} 01:54:17.961326 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 01:54:19.284445 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:54:19.292565 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:54:19.325618 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:54:19.361207 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:54:19.415233 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:54:19.447979 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:54:19.482862 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:54:20.045352 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2352 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:54:20.050670 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:54:20.062659 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:54:20.130880 tst switch_tch_pdch.py: using LAC 18255 01:54:20.256840 tst switch_tch_pdch.py: using RAC 150 01:54:20.389622 tst switch_tch_pdch.py: using CellId 18255 01:54:20.507406 tst switch_tch_pdch.py: using BVCI 18256 01:54:20.616317 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:54:20.627927 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:54:20.639456 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:54:20.651163 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:54:20.662905 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:54:20.674539 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:54:20.686297 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:54:20.698052 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:54:20.816119 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:54:20.934615 tst switch_tch_pdch.py:51: start network... 01:54:21.135776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:21.629261 run create_hlr_db(pid=9277): Launched 01:54:21.760423 bus /gobi_6: Setting Powered False 01:54:22.824235 run create_hlr_db(pid=9277): Terminated: ok {rc=0} 01:54:23.268871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9279): Launched 01:54:23.589701 run osmo-hlr_10.42.42.2(pid=9280): Launched 01:54:23.711220 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:24.264451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9282): Launched 01:54:24.583490 run osmo-stp_10.42.42.5(pid=9283): Launched 01:54:24.705974 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:54:25.258190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9285): Launched 01:54:25.382544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:54:25.651851 run patchelf(pid=9286): Launched 01:54:25.829446 run osmo-stp_10.42.42.5(pid=9283): ERR: Terminated: ERROR {rc=1} [trial-2352↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9283)] 01:54:25.964779 run osmo-stp_10.42.42.5(pid=9283): stdout: | (launched: 2022-12-09_01:54:24.525744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:26.101994 run osmo-stp_10.42.42.5(pid=9283): stderr: | 20221209015424717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015424717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015424717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015424718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015424718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015424718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015424718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:26.239356 run osmo-stp_10.42.42.5(pid=9283): stdout: | (launched: 2022-12-09_01:54:24.525744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:26.370693 run osmo-stp_10.42.42.5(pid=9283): stderr: | 20221209015424717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015424717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015424717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015424718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015424718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015424718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015424718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:26.525998 run patchelf(pid=9286): Terminating (SIGINT) 01:54:26.704762 run patchelf(pid=9286): Terminated: ok {rc=0} 01:54:26.834273 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9283): Process ended prematurely: osmo-stp_10.42.42.5(pid=9283) [trial-2352↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9283)] [trial-2352↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:54:26.843868 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 01:54:26.871912 run osmo-hlr_10.42.42.2(pid=9280): ERR: Terminated: ERROR {rc=237} [trial-2352↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9280)] 01:54:26.922246 run osmo-hlr_10.42.42.2(pid=9280): stdout: | (launched: 2022-12-09_01:54:23.531498) 01:54:26.974386 run osmo-hlr_10.42.42.2(pid=9280): stderr: | 20221209015423731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015423731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015423731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015423731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015423731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015423731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015423744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015423753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015423753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015423753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:27.026988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9279): Terminating (SIGTERM) 01:54:27.069151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9282): Terminating (SIGTERM) 01:54:27.111149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9285): Terminating (SIGTERM) 01:54:27.153362 --- ParallelTerminationStrategy: PID 9279 died... 01:54:27.173302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9279): Terminated: ok {rc=0} 01:54:27.219374 --- ParallelTerminationStrategy: PID 9282 died... 01:54:27.238762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9282): Terminated: ok {rc=0} 01:54:27.284822 --- ParallelTerminationStrategy: PID 9285 died... 01:54:27.304652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9285): Terminated: ok {rc=0} 01:54:27.392696 bus /gobi_0: Setting Powered False 01:54:28.490453 bus /gobi_0: Setting Powered False 01:54:29.607357 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2352 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 nitb_smpp --------------------------------------------------------------------- 01:54:30.873639 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:54:30.876803 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 01:54:30.899856 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 01:54:30.909915 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 01:54:30.950961 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 01:54:30.988806 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 01:54:31.002506 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 01:54:31.509546 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2352 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 01:54:31.515086 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:54:31.538642 tst esme_connect_policy_acceptall.py: using MSISDN 6960 01:54:31.682528 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:54:32.262296 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9290): Launched 01:54:32.590814 run osmo-nitb_10.42.42.2(pid=9291): Launched 01:54:32.773638 run osmo-nitb_10.42.42.2(pid=9291): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9291)] 01:54:32.919466 run osmo-nitb_10.42.42.2(pid=9291): stdout: | (launched: 2022-12-09_01:54:32.531804) 01:54:33.066940 run osmo-nitb_10.42.42.2(pid=9291): stderr: | (launched: 2022-12-09_01:54:32.580475) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:33.214427 run osmo-nitb_10.42.42.2(pid=9291): stdout: | (launched: 2022-12-09_01:54:32.531804) 01:54:33.356614 run osmo-nitb_10.42.42.2(pid=9291): stderr: | (launched: 2022-12-09_01:54:32.580475) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9291) [trial-2352↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9291)] 01:54:33.716378 tst osmo-nitb_10.42.42.2(pid=9291): stdout: | (launched: 2022-12-09_01:54:32.531804) 01:54:33.848777 tst osmo-nitb_10.42.42.2(pid=9291): stderr: | (launched: 2022-12-09_01:54:32.580475) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:34.004661 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=9291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9291) [trial-2352↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9291)] [trial-2352↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 01:54:34.013914 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 01:54:34.021153 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9290): Terminating (SIGTERM) 01:54:34.232319 --- ParallelTerminationStrategy: PID 9290 died... 01:54:34.254053 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9290): Terminated: ok {rc=0} ---------------------------------------------- trial-2352 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 01:54:34.305762 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:54:34.327762 tst esme_connect_policy_closed.py: using MSISDN 6961 01:54:34.457989 tst esme_connect_policy_closed.py: using MSISDN 6962 01:54:34.575676 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:54:35.183241 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9292): Launched 01:54:35.513103 run osmo-nitb_10.42.42.2(pid=9293): Launched 01:54:35.692037 run osmo-nitb_10.42.42.2(pid=9293): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9293)] 01:54:35.827073 run osmo-nitb_10.42.42.2(pid=9293): stdout: | (launched: 2022-12-09_01:54:35.453665) 01:54:35.963406 run osmo-nitb_10.42.42.2(pid=9293): stderr: | (launched: 2022-12-09_01:54:35.502621) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:36.099852 run osmo-nitb_10.42.42.2(pid=9293): stdout: | (launched: 2022-12-09_01:54:35.453665) 01:54:36.230593 run osmo-nitb_10.42.42.2(pid=9293): stderr: | (launched: 2022-12-09_01:54:35.502621) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:36.387221 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=9293): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9293) [trial-2352↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9293)] [trial-2352↪nitb_smpp↪esme_connect_policy_closed.py:24] 01:54:36.396299 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 01:54:36.403334 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9292): Terminating (SIGTERM) 01:54:36.613922 --- ParallelTerminationStrategy: PID 9292 died... 01:54:36.635918 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9292): Terminated: ok {rc=0} ---------------------------------------------- trial-2352 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 01:54:36.687254 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:54:36.698893 tst nitb_smpp: Using 1 x bts (candidates: 1) 01:54:36.735119 tst esme_ms_sms_storeforward.py: using LAC 18256 01:54:36.865781 tst esme_ms_sms_storeforward.py: using RAC 151 01:54:36.994032 tst esme_ms_sms_storeforward.py: using CellId 18256 01:54:37.123846 tst esme_ms_sms_storeforward.py: using BVCI 18257 01:54:37.244613 tst nitb_smpp: Using 1 x modem (candidates: 1) 01:54:37.372883 tst esme_ms_sms_storeforward.py: using MSISDN 6963 01:54:37.485770 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 01:54:37.694928 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:54:38.322526 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9294): Launched 01:54:38.630285 run osmo-nitb_10.42.42.2(pid=9295): Launched 01:54:38.798635 run osmo-nitb_10.42.42.2(pid=9295): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9295)] 01:54:38.925422 run osmo-nitb_10.42.42.2(pid=9295): stdout: | (launched: 2022-12-09_01:54:38.574176) 01:54:39.053714 run osmo-nitb_10.42.42.2(pid=9295): stderr: | (launched: 2022-12-09_01:54:38.619933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:39.181750 run osmo-nitb_10.42.42.2(pid=9295): stdout: | (launched: 2022-12-09_01:54:38.574176) 01:54:39.303822 run osmo-nitb_10.42.42.2(pid=9295): stderr: | (launched: 2022-12-09_01:54:38.619933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:39.450334 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=9295): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9295) [trial-2352↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9295)] [trial-2352↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 01:54:39.458539 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 01:54:39.465090 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9294): Terminating (SIGTERM) 01:54:39.674228 --- ParallelTerminationStrategy: PID 9294 died... 01:54:39.695130 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9294): Terminated: ok {rc=0} 01:54:39.782244 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 01:54:40.870525 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:54:40.881763 tst nitb_smpp: Using 1 x bts (candidates: 1) 01:54:40.917370 tst esme_ms_sms_transaction.py: using LAC 18257 01:54:41.039550 tst esme_ms_sms_transaction.py: using RAC 152 01:54:41.161124 tst esme_ms_sms_transaction.py: using CellId 18257 01:54:41.281056 tst esme_ms_sms_transaction.py: using BVCI 18258 01:54:41.392024 tst nitb_smpp: Using 1 x modem (candidates: 1) 01:54:41.517395 tst esme_ms_sms_transaction.py: using MSISDN 6964 01:54:41.630374 tst esme_ms_sms_transaction.py:18: start nitb and bts... 01:54:41.836785 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:54:42.457469 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9296): Launched 01:54:42.764270 run osmo-nitb_10.42.42.2(pid=9297): Launched 01:54:42.933901 run osmo-nitb_10.42.42.2(pid=9297): ERR: Terminated: ERROR {rc=2} [trial-2352↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9297)] 01:54:43.070948 run osmo-nitb_10.42.42.2(pid=9297): stdout: | (launched: 2022-12-09_01:54:42.708414) 01:54:43.209890 run osmo-nitb_10.42.42.2(pid=9297): stderr: | (launched: 2022-12-09_01:54:42.754061) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:43.348709 run osmo-nitb_10.42.42.2(pid=9297): stdout: | (launched: 2022-12-09_01:54:42.708414) 01:54:43.481515 run osmo-nitb_10.42.42.2(pid=9297): stderr: | (launched: 2022-12-09_01:54:42.754061) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3bd479268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9297): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9297) [trial-2352↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9297)] 01:54:43.880448 tst osmo-nitb_10.42.42.2(pid=9297): stdout: | (launched: 2022-12-09_01:54:42.708414) 01:54:44.005073 tst osmo-nitb_10.42.42.2(pid=9297): stderr: | (launched: 2022-12-09_01:54:42.754061) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:44.151505 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=9297): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9297) [trial-2352↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9297)] [trial-2352↪nitb_smpp↪esme_ms_sms_transaction.py:21] 01:54:44.159950 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 01:54:44.166508 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9296): Terminating (SIGTERM) 01:54:44.377628 --- ParallelTerminationStrategy: PID 9296 died... 01:54:44.398699 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9296): Terminated: ok {rc=0} 01:54:44.487308 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 smpp --------------------------------------------------------------------- 01:54:45.653559 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:54:45.656531 tst smpp: Verifying 1 x bts (candidates: 11) 01:54:45.677765 tst smpp: Verifying 6 x ip_address (candidates: 9) 01:54:45.704898 tst smpp: Verifying 1 x modem (candidates: 12) 01:54:45.740352 tst smpp: Reserving 1 x bts (candidates: 11) 01:54:45.761083 tst smpp: Reserving 6 x ip_address (candidates: 9) 01:54:45.787356 tst smpp: Reserving 1 x modem (candidates: 12) 01:54:46.337669 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2352 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 01:54:46.345287 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:46.357372 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:46.369977 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:46.383193 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:46.402898 tst esme_connect_policy_acceptall.py: using MSISDN 6965 01:54:46.531010 run osmo-stp_10.42.42.4: Starting osmo-stp 01:54:47.101470 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9301): Launched 01:54:47.439920 run osmo-stp_10.42.42.4(pid=9302): Launched 01:54:47.567665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:48.076729 run create_hlr_db(pid=9303): Launched 01:54:48.211991 bus /sierra_2: Setting Powered False 01:54:49.278593 run create_hlr_db(pid=9303): Terminated: ok {rc=0} 01:54:49.715756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9305): Launched 01:54:50.022747 run osmo-hlr_10.42.42.2(pid=9306): Launched 01:54:50.139601 run osmo-msc_10.42.42.5: Starting osmo-msc 01:54:50.705909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9308): Launched 01:54:51.012823 run osmo-msc_10.42.42.5(pid=9309): Launched 01:54:51.184041 run osmo-hlr_10.42.42.2(pid=9306): ERR: Terminated: ERROR {rc=237} [trial-2352↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9306)] 01:54:51.348406 run osmo-hlr_10.42.42.2(pid=9306): stdout: | (launched: 2022-12-09_01:54:49.966701) 01:54:51.478746 run osmo-hlr_10.42.42.2(pid=9306): stderr: | 20221209015450139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015450139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015450139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015450139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015450139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015450139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015450152 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015450161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015450162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015450162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:51.606416 run osmo-hlr_10.42.42.2(pid=9306): stdout: | (launched: 2022-12-09_01:54:49.966701) 01:54:51.728267 run osmo-hlr_10.42.42.2(pid=9306): stderr: | 20221209015450139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015450139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015450139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015450139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015450139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015450139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015450152 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015450161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015450162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015450162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:51.874709 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=9306): Process ended prematurely: osmo-hlr_10.42.42.2(pid=9306) [trial-2352↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9306)] [trial-2352↪smpp↪esme_connect_policy_acceptall.py:23] 01:54:51.882909 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.5 sec) 01:54:51.909307 run osmo-msc_10.42.42.5(pid=9309): ERR: Terminated: ERROR {rc=9} [trial-2352↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=9309)] 01:54:51.957894 run osmo-msc_10.42.42.5(pid=9309): stdout: | (launched: 2022-12-09_01:54:50.956406) 01:54:52.007712 run osmo-msc_10.42.42.5(pid=9309): stderr: | 20221209015451275 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209015451275 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209015451275 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015451275 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209015451276 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209015451276 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209015451276 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209015451276 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209015451276 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 01:54:52.058134 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9301): Terminating (SIGTERM) 01:54:52.098082 run osmo-stp_10.42.42.4(pid=9302): Terminating (SIGTERM) 01:54:52.138046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9305): Terminating (SIGTERM) 01:54:52.179901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9308): Terminating (SIGTERM) 01:54:52.221772 --- ParallelTerminationStrategy: PID 9301 died... 01:54:52.241214 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9301): Terminated: ok {rc=0} 01:54:52.286198 --- ParallelTerminationStrategy: PID 9302 died... 01:54:52.304607 run osmo-stp_10.42.42.4(pid=9302): Terminated: ok {rc=0} 01:54:52.349105 --- ParallelTerminationStrategy: PID 9305 died... 01:54:52.368043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9305): Terminated: ok {rc=0} 01:54:52.412532 --- ParallelTerminationStrategy: PID 9308 died... 01:54:52.431290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9308): Terminated: ok {rc=0} ---------------------------------------------- trial-2352 smpp esme_connect_policy_closed.py ---------------------------------------------- 01:54:52.480175 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:52.491167 tst smpp: Using 1 x bts (candidates: 1) 01:54:52.525955 tst esme_connect_policy_closed.py: using LAC 18258 01:54:52.649398 tst esme_connect_policy_closed.py: using RAC 153 01:54:52.775248 tst esme_connect_policy_closed.py: using CellId 18258 01:54:52.893668 tst esme_connect_policy_closed.py: using BVCI 18259 01:54:53.006515 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:53.016825 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:53.027080 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:53.055220 tst esme_connect_policy_closed.py: using MSISDN 6966 01:54:53.182887 tst esme_connect_policy_closed.py: using MSISDN 6967 01:54:53.294534 run osmo-stp_10.42.42.4: Starting osmo-stp 01:54:53.817113 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9312): Launched 01:54:54.123716 run osmo-stp_10.42.42.4(pid=9313): Launched 01:54:54.241871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:54.715991 run create_hlr_db(pid=9314): Launched 01:54:55.888459 run create_hlr_db(pid=9314): Terminated: ok {rc=0} 01:54:56.212855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9316): Launched 01:54:56.519299 run osmo-hlr_10.42.42.2(pid=9317): Launched 01:54:56.636706 run osmo-msc_10.42.42.5: Starting osmo-msc 01:54:57.192718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9319): Launched 01:54:57.499534 run osmo-msc_10.42.42.5(pid=9320): Launched 01:54:57.671666 run osmo-hlr_10.42.42.2(pid=9317): ERR: Terminated: ERROR {rc=237} [trial-2352↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9317)] 01:54:57.807380 run osmo-hlr_10.42.42.2(pid=9317): stdout: | (launched: 2022-12-09_01:54:56.463189) 01:54:57.948775 run osmo-hlr_10.42.42.2(pid=9317): stderr: | 20221209015456637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015456637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015456637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015456638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015456638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015456638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015456663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015456672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015456672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015456672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:58.080654 run osmo-hlr_10.42.42.2(pid=9317): stdout: | (launched: 2022-12-09_01:54:56.463189) 01:54:58.202702 run osmo-hlr_10.42.42.2(pid=9317): stderr: | 20221209015456637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015456637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015456637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015456638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015456638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015456638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015456663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015456672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015456672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015456672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:58.348893 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=9317): Process ended prematurely: osmo-hlr_10.42.42.2(pid=9317) [trial-2352↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9317)] [trial-2352↪smpp↪esme_connect_policy_closed.py:31] 01:54:58.357310 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 01:54:58.383851 run osmo-msc_10.42.42.5(pid=9320): ERR: Terminated: ERROR {rc=9} [trial-2352↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=9320)] 01:54:58.431915 run osmo-msc_10.42.42.5(pid=9320): stdout: | (launched: 2022-12-09_01:54:57.443218) 01:54:58.482358 run osmo-msc_10.42.42.5(pid=9320): stderr: | 20221209015457760 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209015457760 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209015457760 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015457760 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209015457760 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209015457760 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209015457760 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209015457760 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209015457760 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 01:54:58.532612 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9312): Terminating (SIGTERM) 01:54:58.573118 run osmo-stp_10.42.42.4(pid=9313): Terminating (SIGTERM) 01:54:58.613408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9316): Terminating (SIGTERM) 01:54:58.654923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9319): Terminating (SIGTERM) 01:54:58.696591 --- ParallelTerminationStrategy: PID 9312 died... 01:54:58.716001 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9312): Terminated: ok {rc=0} 01:54:58.761710 --- ParallelTerminationStrategy: PID 9313 died... 01:54:58.780364 run osmo-stp_10.42.42.4(pid=9313): Terminated: ok {rc=0} 01:54:58.825079 --- ParallelTerminationStrategy: PID 9316 died... 01:54:58.843635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9316): Terminated: ok {rc=0} 01:54:58.887964 --- ParallelTerminationStrategy: PID 9319 died... 01:54:58.906698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9319): Terminated: ok {rc=0} ---------------------------------------------- trial-2352 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 01:54:58.956451 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:58.967449 tst smpp: Using 1 x bts (candidates: 1) 01:54:59.003561 tst esme_ms_sms_storeforward.py: using LAC 18259 01:54:59.137282 tst esme_ms_sms_storeforward.py: using RAC 154 01:54:59.268254 tst esme_ms_sms_storeforward.py: using CellId 18259 01:54:59.391133 tst esme_ms_sms_storeforward.py: using BVCI 18260 01:54:59.505179 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:59.515641 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:59.526122 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:59.536898 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:59.547528 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:59.557926 tst smpp: Using 1 x modem (candidates: 1) 01:54:59.689348 tst esme_ms_sms_storeforward.py: using MSISDN 6968 01:54:59.810872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:55:00.324150 run create_hlr_db(pid=9323): Launched 01:55:01.550007 run create_hlr_db(pid=9323): Terminated: ok {rc=0} 01:55:01.883815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9328): Launched 01:55:02.212296 run osmo-hlr_10.42.42.2(pid=9329): Launched 01:55:02.338045 run osmo-stp_10.42.42.5: Starting osmo-stp 01:55:02.889771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9331): Launched 01:55:03.206825 run osmo-stp_10.42.42.5(pid=9332): Launched 01:55:03.325225 run osmo-msc_10.42.42.6: Starting osmo-msc 01:55:03.882325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9334): Launched 01:55:04.191074 run osmo-msc_10.42.42.6(pid=9335): Launched 01:55:04.364646 run osmo-stp_10.42.42.5(pid=9332): ERR: Terminated: ERROR {rc=1} [trial-2352↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9332)] 01:55:04.495439 run osmo-stp_10.42.42.5(pid=9332): stdout: | (launched: 2022-12-09_01:55:03.149609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:04.626130 run osmo-stp_10.42.42.5(pid=9332): stderr: | 20221209015503321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015503321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015503321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015503322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015503324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015503324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015503324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:04.754579 run osmo-stp_10.42.42.5(pid=9332): stdout: | (launched: 2022-12-09_01:55:03.149609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:04.877280 run osmo-stp_10.42.42.5(pid=9332): stderr: | 20221209015503321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015503321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015503321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015503322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015503324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015503324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015503324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:05.023934 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=9332): Process ended prematurely: osmo-stp_10.42.42.5(pid=9332) [trial-2352↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9332)] [trial-2352↪smpp↪esme_ms_sms_storeforward.py:30] 01:55:05.032466 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec) 01:55:05.059114 run osmo-hlr_10.42.42.2(pid=9329): ERR: Terminated: ERROR {rc=237} [trial-2352↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9329)] 01:55:05.108169 run osmo-hlr_10.42.42.2(pid=9329): stdout: | (launched: 2022-12-09_01:55:02.151259) 01:55:05.158661 run osmo-hlr_10.42.42.2(pid=9329): stderr: | 20221209015502349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015502350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015502350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015502350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015502350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015502350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015502362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015502370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015502371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015502371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:55:05.228883 run osmo-msc_10.42.42.6(pid=9335): ERR: Terminated: ERROR {rc=2} [trial-2352↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9335)] 01:55:05.277486 run osmo-msc_10.42.42.6(pid=9335): stdout: | (launched: 2022-12-09_01:55:04.134214) 01:55:05.327963 run osmo-msc_10.42.42.6(pid=9335): stderr: | 20221209015504406 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015504407 DLGLOBAL DEBUG validating counter group 0x7f15815dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015504407 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015504407 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015504407 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015504407 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015504409 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015504410 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015504410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015504410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:55:05.378822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9328): Terminating (SIGTERM) 01:55:05.419386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9331): Terminating (SIGTERM) 01:55:05.459814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9334): Terminating (SIGTERM) 01:55:05.500627 --- ParallelTerminationStrategy: PID 9328 died... 01:55:05.520065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9328): Terminated: ok {rc=0} 01:55:05.565722 --- ParallelTerminationStrategy: PID 9331 died... 01:55:05.584537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9331): Terminated: ok {rc=0} 01:55:05.629784 --- ParallelTerminationStrategy: PID 9334 died... 01:55:05.648591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9334): Terminated: ok {rc=0} 01:55:05.733802 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 smpp esme_ms_sms_transaction.py ---------------------------------------------- 01:55:06.820922 tst smpp: Using 1 x ip_address (candidates: 6) 01:55:06.832476 tst smpp: Using 1 x bts (candidates: 1) 01:55:06.874403 tst esme_ms_sms_transaction.py: using LAC 18260 01:55:07.002550 tst esme_ms_sms_transaction.py: using RAC 155 01:55:07.134305 tst esme_ms_sms_transaction.py: using CellId 18260 01:55:07.262574 tst esme_ms_sms_transaction.py: using BVCI 18261 01:55:07.381900 tst smpp: Using 1 x ip_address (candidates: 6) 01:55:07.392600 tst smpp: Using 1 x ip_address (candidates: 6) 01:55:07.403491 tst smpp: Using 1 x ip_address (candidates: 6) 01:55:07.414268 tst smpp: Using 1 x ip_address (candidates: 6) 01:55:07.424937 tst smpp: Using 1 x ip_address (candidates: 6) 01:55:07.435625 tst smpp: Using 1 x modem (candidates: 1) 01:55:07.563457 tst esme_ms_sms_transaction.py: using MSISDN 6969 01:55:07.682187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:55:08.191245 run create_hlr_db(pid=9337): Launched 01:55:08.327068 bus /sierra_2: Setting Powered False 01:55:09.391833 run create_hlr_db(pid=9337): Terminated: ok {rc=0} 01:55:09.851675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9339): Launched 01:55:10.182823 run osmo-hlr_10.42.42.2(pid=9340): Launched 01:55:10.309616 run osmo-stp_10.42.42.5: Starting osmo-stp 01:55:10.875369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9342): Launched 01:55:11.203759 run osmo-stp_10.42.42.5(pid=9343): Launched 01:55:11.329606 run osmo-msc_10.42.42.6: Starting osmo-msc 01:55:11.924677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9345): Launched 01:55:12.254322 run osmo-msc_10.42.42.6(pid=9346): Launched 01:55:12.438056 run osmo-stp_10.42.42.5(pid=9343): ERR: Terminated: ERROR {rc=1} [trial-2352↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9343)] 01:55:12.575748 run osmo-stp_10.42.42.5(pid=9343): stdout: | (launched: 2022-12-09_01:55:11.143457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:12.714204 run osmo-stp_10.42.42.5(pid=9343): stderr: | 20221209015511338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015511338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015511338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015511338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015511341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015511341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015511341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:12.851323 run osmo-stp_10.42.42.5(pid=9343): stdout: | (launched: 2022-12-09_01:55:11.143457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:12.981597 run osmo-stp_10.42.42.5(pid=9343): stderr: | 20221209015511338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015511338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015511338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015511338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015511341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015511341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015511341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:13.137942 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=9343): Process ended prematurely: osmo-stp_10.42.42.5(pid=9343) [trial-2352↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9343)] [trial-2352↪smpp↪esme_ms_sms_transaction.py:28] 01:55:13.146789 tst esme_ms_sms_transaction.py:28: Test FAILED (6.3 sec) 01:55:13.174180 run osmo-hlr_10.42.42.2(pid=9340): ERR: Terminated: ERROR {rc=237} [trial-2352↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9340)] 01:55:13.224674 run osmo-hlr_10.42.42.2(pid=9340): stdout: | (launched: 2022-12-09_01:55:10.122347) 01:55:13.277111 run osmo-hlr_10.42.42.2(pid=9340): stderr: | 20221209015510323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015510323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015510323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015510323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015510323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015510323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015510340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015510350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015510350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015510350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:55:13.349912 run osmo-msc_10.42.42.6(pid=9346): ERR: Terminated: ERROR {rc=2} [trial-2352↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9346)] 01:55:13.400635 run osmo-msc_10.42.42.6(pid=9346): stdout: | (launched: 2022-12-09_01:55:12.193693) 01:55:13.452901 run osmo-msc_10.42.42.6(pid=9346): stderr: | 20221209015512518 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015512518 DLGLOBAL DEBUG validating counter group 0x7fea5a675c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015512518 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015512518 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015512518 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015512518 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015512522 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015512523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015512523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015512523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:55:13.505584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9339): Terminating (SIGTERM) 01:55:13.547450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9342): Terminating (SIGTERM) 01:55:13.589678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9345): Terminating (SIGTERM) 01:55:13.632162 --- ParallelTerminationStrategy: PID 9339 died... 01:55:13.652367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9339): Terminated: ok {rc=0} 01:55:13.698920 --- ParallelTerminationStrategy: PID 9342 died... 01:55:13.718574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9342): Terminated: ok {rc=0} 01:55:13.765060 --- ParallelTerminationStrategy: PID 9345 died... 01:55:13.784811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9345): Terminated: ok {rc=0} 01:55:13.872477 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 encryption --------------------------------------------------------------------- 01:55:15.067487 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:55:15.070911 tst encryption: Verifying 1 x bts (candidates: 11) 01:55:15.092609 tst encryption: Verifying 6 x ip_address (candidates: 9) 01:55:15.120035 tst encryption: Verifying 1 x modem (candidates: 12) 01:55:15.156490 tst encryption: Reserving 1 x bts (candidates: 11) 01:55:15.178517 tst encryption: Reserving 6 x ip_address (candidates: 9) 01:55:15.206222 tst encryption: Reserving 1 x modem (candidates: 12) 01:55:15.734212 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2352 encryption register_a5_0_authopt.py ---------------------------------------------- 01:55:15.789873 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:15.800645 tst encryption: Using 1 x bts (candidates: 1) 01:55:15.842623 tst register_a5_0_authopt.py: using LAC 18261 01:55:15.995348 tst register_a5_0_authopt.py: using RAC 156 01:55:16.130525 tst register_a5_0_authopt.py: using CellId 18261 01:55:16.256788 tst register_a5_0_authopt.py: using BVCI 18262 01:55:16.374268 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:16.385913 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:16.397686 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:16.409267 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:16.421362 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:16.433932 tst encryption: Using 1 x modem (candidates: 1) 01:55:16.564242 tst register_a5_0_authopt.py:8: start network... 01:55:16.806680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:55:17.300303 run create_hlr_db(pid=9352): Launched 01:55:17.421931 bus /sierra_2: Setting Powered False 01:55:18.483377 run create_hlr_db(pid=9352): Terminated: ok {rc=0} 01:55:18.939189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9354): Launched 01:55:19.274812 run osmo-hlr_10.42.42.2(pid=9355): Launched 01:55:19.404202 run osmo-stp_10.42.42.5: Starting osmo-stp 01:55:19.980368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9357): Launched 01:55:20.312551 run osmo-stp_10.42.42.5(pid=9358): Launched 01:55:20.439554 run osmo-msc_10.42.42.6: Starting osmo-msc 01:55:21.037988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9360): Launched 01:55:21.371610 run osmo-msc_10.42.42.6(pid=9361): Launched 01:55:21.557465 run osmo-stp_10.42.42.5(pid=9358): ERR: Terminated: ERROR {rc=1} [trial-2352↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9358)] 01:55:21.697398 run osmo-stp_10.42.42.5(pid=9358): stdout: | (launched: 2022-12-09_01:55:20.252234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:21.838009 run osmo-stp_10.42.42.5(pid=9358): stderr: | 20221209015520448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015520448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015520449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015520449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015520450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015520450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015520450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:21.976588 run osmo-stp_10.42.42.5(pid=9358): stdout: | (launched: 2022-12-09_01:55:20.252234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:22.109593 run osmo-stp_10.42.42.5(pid=9358): stderr: | 20221209015520448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015520448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015520449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015520449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015520450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015520450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015520450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:22.267436 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9358): Process ended prematurely: osmo-stp_10.42.42.5(pid=9358) [trial-2352↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9358)] [trial-2352↪encryption↪register_a5_0_authopt.py:8] 01:55:22.276924 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 01:55:22.304749 run osmo-hlr_10.42.42.2(pid=9355): ERR: Terminated: ERROR {rc=237} [trial-2352↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9355)] 01:55:22.355630 run osmo-hlr_10.42.42.2(pid=9355): stdout: | (launched: 2022-12-09_01:55:19.214346) 01:55:22.408516 run osmo-hlr_10.42.42.2(pid=9355): stderr: | 20221209015519416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015519416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015519416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015519416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015519416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015519416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015519447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015519457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015519458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015519458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:55:22.481840 run osmo-msc_10.42.42.6(pid=9361): ERR: Terminated: ERROR {rc=2} [trial-2352↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9361)] 01:55:22.532667 run osmo-msc_10.42.42.6(pid=9361): stdout: | (launched: 2022-12-09_01:55:21.310751) 01:55:22.585398 run osmo-msc_10.42.42.6(pid=9361): stderr: | 20221209015521635 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015521635 DLGLOBAL DEBUG validating counter group 0x7f4391533c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015521635 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015521635 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015521635 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015521635 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015521637 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015521638 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015521638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015521638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:55:22.638085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9354): Terminating (SIGTERM) 01:55:22.680235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9357): Terminating (SIGTERM) 01:55:22.722638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9360): Terminating (SIGTERM) 01:55:22.765271 --- ParallelTerminationStrategy: PID 9354 died... 01:55:22.785526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9354): Terminated: ok {rc=0} 01:55:22.832657 --- ParallelTerminationStrategy: PID 9357 died... 01:55:22.852564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9357): Terminated: ok {rc=0} 01:55:22.899359 --- ParallelTerminationStrategy: PID 9360 died... 01:55:22.919134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9360): Terminated: ok {rc=0} 01:55:23.007816 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 encryption register_a5_0_authreq.py ---------------------------------------------- 01:55:24.161780 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:24.173668 tst encryption: Using 1 x bts (candidates: 1) 01:55:24.211300 tst register_a5_0_authreq.py: using LAC 18262 01:55:24.344313 tst register_a5_0_authreq.py: using RAC 157 01:55:24.477906 tst register_a5_0_authreq.py: using CellId 18262 01:55:24.610796 tst register_a5_0_authreq.py: using BVCI 18263 01:55:24.733965 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:24.744863 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:24.755819 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:24.767230 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:24.778650 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:24.789903 tst encryption: Using 1 x modem (candidates: 1) 01:55:24.911292 tst register_a5_0_authreq.py:8: start network... 01:55:25.139612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:55:25.654770 run create_hlr_db(pid=9363): Launched 01:55:25.791206 bus /sierra_2: Setting Powered False 01:55:26.856469 run create_hlr_db(pid=9363): Terminated: ok {rc=0} 01:55:27.299784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9365): Launched 01:55:27.611961 run osmo-hlr_10.42.42.2(pid=9366): Launched 01:55:27.732496 run osmo-stp_10.42.42.5: Starting osmo-stp 01:55:28.283951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9368): Launched 01:55:28.595539 run osmo-stp_10.42.42.5(pid=9369): Launched 01:55:28.716095 run osmo-msc_10.42.42.6: Starting osmo-msc 01:55:29.276847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9371): Launched 01:55:29.588566 run osmo-msc_10.42.42.6(pid=9372): Launched 01:55:29.764789 run osmo-stp_10.42.42.5(pid=9369): ERR: Terminated: ERROR {rc=1} [trial-2352↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9369)] 01:55:29.896038 run osmo-stp_10.42.42.5(pid=9369): stdout: | (launched: 2022-12-09_01:55:28.538321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:30.027219 run osmo-stp_10.42.42.5(pid=9369): stderr: | 20221209015528712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015528712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015528712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015528712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015528713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015528713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015528713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:30.157195 run osmo-stp_10.42.42.5(pid=9369): stdout: | (launched: 2022-12-09_01:55:28.538321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:30.282632 run osmo-stp_10.42.42.5(pid=9369): stderr: | 20221209015528712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015528712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015528712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015528712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015528713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015528713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015528713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:30.430241 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9369): Process ended prematurely: osmo-stp_10.42.42.5(pid=9369) [trial-2352↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9369)] [trial-2352↪encryption↪register_a5_0_authreq.py:8] 01:55:30.439139 tst register_a5_0_authreq.py:8: Test FAILED (6.3 sec) 01:55:30.465570 run osmo-hlr_10.42.42.2(pid=9366): ERR: Terminated: ERROR {rc=237} [trial-2352↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9366)] 01:55:30.514211 run osmo-hlr_10.42.42.2(pid=9366): stdout: | (launched: 2022-12-09_01:55:27.554957) 01:55:30.564188 run osmo-hlr_10.42.42.2(pid=9366): stderr: | 20221209015527735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015527735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015527735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015527735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015527735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015527735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015527748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015527758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015527758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015527758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:55:30.633912 run osmo-msc_10.42.42.6(pid=9372): ERR: Terminated: ERROR {rc=2} [trial-2352↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9372)] 01:55:30.682069 run osmo-msc_10.42.42.6(pid=9372): stdout: | (launched: 2022-12-09_01:55:29.531453) 01:55:30.731772 run osmo-msc_10.42.42.6(pid=9372): stderr: | 20221209015529804 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015529804 DLGLOBAL DEBUG validating counter group 0x7f160f594c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015529804 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015529804 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015529805 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015529805 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015529807 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015529807 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015529807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015529807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:55:30.781984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9365): Terminating (SIGTERM) 01:55:30.821792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9368): Terminating (SIGTERM) 01:55:30.867209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9371): Terminating (SIGTERM) 01:55:30.915519 --- ParallelTerminationStrategy: PID 9365 died... 01:55:30.935233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9365): Terminated: ok {rc=0} 01:55:30.984244 --- ParallelTerminationStrategy: PID 9368 died... 01:55:31.003899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9368): Terminated: ok {rc=0} 01:55:31.051552 --- ParallelTerminationStrategy: PID 9371 died... 01:55:31.071319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9371): Terminated: ok {rc=0} 01:55:31.160009 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 encryption register_a5_1_authreq.py ---------------------------------------------- 01:55:32.311026 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:32.322368 tst encryption: Using 1 x bts (candidates: 1) 01:55:32.360112 tst register_a5_1_authreq.py: using LAC 18263 01:55:32.484530 tst register_a5_1_authreq.py: using RAC 158 01:55:32.608333 tst register_a5_1_authreq.py: using CellId 18263 01:55:32.734782 tst register_a5_1_authreq.py: using BVCI 18264 01:55:32.848885 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:32.859405 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:32.869796 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:32.880355 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:32.891034 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:32.901607 tst encryption: Using 1 x modem (candidates: 1) 01:55:33.018567 tst register_a5_1_authreq.py:8: start network... 01:55:33.247297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:55:33.764674 run create_hlr_db(pid=9374): Launched 01:55:33.900080 bus /sierra_2: Setting Powered False 01:55:34.966415 run create_hlr_db(pid=9374): Terminated: ok {rc=0} 01:55:35.411857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9377): Launched 01:55:35.723647 run osmo-hlr_10.42.42.2(pid=9378): Launched 01:55:35.843061 run osmo-stp_10.42.42.5: Starting osmo-stp 01:55:36.420600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9380): Launched 01:55:36.754417 run osmo-stp_10.42.42.5(pid=9381): Launched 01:55:36.882951 run osmo-msc_10.42.42.6: Starting osmo-msc 01:55:37.483649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9383): Launched 01:55:37.818649 run osmo-msc_10.42.42.6(pid=9384): Launched 01:55:38.005690 run osmo-stp_10.42.42.5(pid=9381): ERR: Terminated: ERROR {rc=1} [trial-2352↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9381)] 01:55:38.146207 run osmo-stp_10.42.42.5(pid=9381): stdout: | (launched: 2022-12-09_01:55:36.693768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:38.287021 run osmo-stp_10.42.42.5(pid=9381): stderr: | 20221209015536887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015536887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015536888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015536888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015536889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015536889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015536889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:38.427102 run osmo-stp_10.42.42.5(pid=9381): stdout: | (launched: 2022-12-09_01:55:36.693768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:38.559972 run osmo-stp_10.42.42.5(pid=9381): stderr: | 20221209015536887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015536887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015536888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015536888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015536889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015536889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015536889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:38.718686 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9381): Process ended prematurely: osmo-stp_10.42.42.5(pid=9381) [trial-2352↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9381)] [trial-2352↪encryption↪register_a5_1_authreq.py:8] 01:55:38.728382 tst register_a5_1_authreq.py:8: Test FAILED (6.5 sec) 01:55:38.756116 run osmo-hlr_10.42.42.2(pid=9378): ERR: Terminated: ERROR {rc=237} [trial-2352↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9378)] 01:55:38.806614 run osmo-hlr_10.42.42.2(pid=9378): stdout: | (launched: 2022-12-09_01:55:35.666593) 01:55:38.858923 run osmo-hlr_10.42.42.2(pid=9378): stderr: | 20221209015535845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015535845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015535845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015535845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015535845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015535845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015535861 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015535870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015535870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015535870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:55:38.931781 run osmo-msc_10.42.42.6(pid=9384): ERR: Terminated: ERROR {rc=2} [trial-2352↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9384)] 01:55:38.982149 run osmo-msc_10.42.42.6(pid=9384): stdout: | (launched: 2022-12-09_01:55:37.758107) 01:55:39.034221 run osmo-msc_10.42.42.6(pid=9384): stderr: | 20221209015538082 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015538082 DLGLOBAL DEBUG validating counter group 0x7fbee2801c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015538083 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015538083 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015538083 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015538083 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015538085 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015538085 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015538085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015538085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:55:39.086640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9377): Terminating (SIGTERM) 01:55:39.128711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9380): Terminating (SIGTERM) 01:55:39.171028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9383): Terminating (SIGTERM) 01:55:39.213526 --- ParallelTerminationStrategy: PID 9377 died... 01:55:39.233807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9377): Terminated: ok {rc=0} 01:55:39.280652 --- ParallelTerminationStrategy: PID 9380 died... 01:55:39.300720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9380): Terminated: ok {rc=0} 01:55:39.347379 --- ParallelTerminationStrategy: PID 9383 died... 01:55:39.367749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9383): Terminated: ok {rc=0} 01:55:39.456195 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2352 encryption register_a5_3_authreq.py ---------------------------------------------- 01:55:40.605794 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:40.617129 tst encryption: Using 1 x bts (candidates: 1) 01:55:40.655020 tst register_a5_3_authreq.py: using LAC 18264 01:55:40.779924 tst register_a5_3_authreq.py: using RAC 159 01:55:40.904245 tst register_a5_3_authreq.py: using CellId 18264 01:55:41.026730 tst register_a5_3_authreq.py: using BVCI 18265 01:55:41.142656 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:41.153266 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:41.163565 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:41.174633 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:41.185829 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:41.196694 tst encryption: Using 1 x modem (candidates: 1) 01:55:41.322418 tst register_a5_3_authreq.py:8: start network... 01:55:41.532788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:55:42.012116 run create_hlr_db(pid=9386): Launched 01:55:42.130522 bus /sierra_2: Setting Powered False 01:55:43.192268 run create_hlr_db(pid=9386): Terminated: ok {rc=0} 01:55:43.646826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9388): Launched 01:55:43.979869 run osmo-hlr_10.42.42.2(pid=9389): Launched 01:55:44.107717 run osmo-stp_10.42.42.5: Starting osmo-stp 01:55:44.680008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9391): Launched 01:55:45.012767 run osmo-stp_10.42.42.5(pid=9392): Launched 01:55:45.140777 run osmo-msc_10.42.42.6: Starting osmo-msc 01:55:45.743643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9394): Launched 01:55:46.093215 run osmo-msc_10.42.42.6(pid=9395): Launched 01:55:46.467549 run osmo-stp_10.42.42.5(pid=9392): ERR: Terminated: ERROR {rc=1} [trial-2352↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9392)] 01:55:46.628698 run osmo-stp_10.42.42.5(pid=9392): stdout: | (launched: 2022-12-09_01:55:44.952133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:46.835554 run osmo-stp_10.42.42.5(pid=9392): stderr: | 20221209015545147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015545147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015545147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015545148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015545148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015545148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015545148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:46.985374 run osmo-stp_10.42.42.5(pid=9392): stdout: | (launched: 2022-12-09_01:55:44.952133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:47.122839 run osmo-stp_10.42.42.5(pid=9392): stderr: | 20221209015545147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015545147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015545147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015545148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015545148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015545148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015545148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:47.286476 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9392): Process ended prematurely: osmo-stp_10.42.42.5(pid=9392) [trial-2352↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9392)] [trial-2352↪encryption↪register_a5_3_authreq.py:8] 01:55:47.297296 tst register_a5_3_authreq.py:8: Test FAILED (6.7 sec) 01:55:47.325260 run osmo-hlr_10.42.42.2(pid=9389): ERR: Terminated: ERROR {rc=237} [trial-2352↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9389)] 01:55:47.373857 run osmo-hlr_10.42.42.2(pid=9389): stdout: | (launched: 2022-12-09_01:55:43.919519) 01:55:47.424034 run osmo-hlr_10.42.42.2(pid=9389): stderr: | 20221209015544120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015544120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015544120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015544120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015544120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015544120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015544135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015544145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015544146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015544146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:55:47.493859 run osmo-msc_10.42.42.6(pid=9395): ERR: Terminated: ERROR {rc=2} [trial-2352↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9395)] 01:55:47.542343 run osmo-msc_10.42.42.6(pid=9395): stdout: | (launched: 2022-12-09_01:55:46.030170) 01:55:47.592598 run osmo-msc_10.42.42.6(pid=9395): stderr: | 20221209015546553 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015546553 DLGLOBAL DEBUG validating counter group 0x7fd622202c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015546553 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015546554 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015546554 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015546554 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015546556 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015546556 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015546556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015546556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:55:47.642950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9388): Terminating (SIGTERM) 01:55:47.683760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9391): Terminating (SIGTERM) 01:55:47.724596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9394): Terminating (SIGTERM) 01:55:47.765529 --- ParallelTerminationStrategy: PID 9388 died... 01:55:47.784491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9388): Terminated: ok {rc=0} 01:55:47.830523 --- ParallelTerminationStrategy: PID 9391 died... 01:55:47.849137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9391): Terminated: ok {rc=0} 01:55:47.894325 --- ParallelTerminationStrategy: PID 9394 died... 01:55:47.912895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9394): Terminated: ok {rc=0} 01:55:47.999445 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 01:55:49.205983 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:55:49.210916 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 01:55:49.229166 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 01:55:49.256826 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 01:55:49.284034 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 01:55:49.302181 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 01:55:49.328698 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 01:55:49.840182 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2352 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 01:55:49.845765 tst handover.py:11: TEST_CONFIG: {} 01:55:50.053822 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:55:50.069784 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:55:50.092757 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:55:50.141653 tst handover.py: using MSISDN 6970 01:55:50.256014 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6970', subscriber_id=0} 01:55:50.363736 run srsepc_10.42.42.118: Starting srsepc 01:55:52.215252 run rm-remote-dir(pid=9400): Launched 01:55:52.340610 bus /sierra_2: Setting Powered False 01:55:53.406426 run rm-remote-dir(pid=9400): Terminated: ok {rc=0} 01:55:53.851558 run mk-remote-dir(pid=9401): Launched 01:55:55.032239 run mk-remote-dir(pid=9401): Terminated: ok {rc=0} 01:55:55.321411 run scp-inst-to-remote(pid=9402): Launched 01:55:57.501454 run scp-inst-to-remote(pid=9402): Terminated: ok {rc=0} 01:55:57.838877 run rm-remote-dir(pid=9404): Launched 01:55:59.018989 run rm-remote-dir(pid=9404): Terminated: ok {rc=0} 01:55:59.357719 run mk-remote-dir(pid=9405): Launched 01:56:00.539391 run mk-remote-dir(pid=9405): Terminated: ok {rc=0} 01:56:00.837547 run scp-cfg-to-remote(pid=9406): Launched 01:56:02.065543 run scp-cfg-to-remote(pid=9406): Terminated: ok {rc=0} 01:56:02.380052 run scp-db-to-remote(pid=9408): Launched 01:56:03.573644 run scp-db-to-remote(pid=9408): Terminated: ok {rc=0} 01:56:03.716211 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:56:04.049659 run patchelf(pid=9410): Launched 01:56:05.240377 run patchelf(pid=9410): Terminated: ok {rc=0} 01:56:05.383248 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:56:05.717680 run setcap-netadm(pid=9411): Launched 01:56:06.909525 run setcap-netadm(pid=9411): Terminated: ok {rc=0} 01:56:07.259275 run srsepc(pid=9412): Launched 01:56:07.385772 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:56:08.582612 run rm-remote-dir(pid=9413): Launched 01:56:08.775351 run srsepc(pid=9412): ERR: Terminated: ERROR {rc=127} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9412)] 01:56:08.922055 run srsepc(pid=9412): stdout: | (launched: 2022-12-09_01:56:07.198588) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:09.068252 run srsepc(pid=9412): stderr: | (launched: 2022-12-09_01:56:07.247945) | Connection to 10.42.42.116 closed. 01:56:09.214758 run srsepc(pid=9412): stdout: | (launched: 2022-12-09_01:56:07.198588) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:09.355643 run srsepc(pid=9412): stderr: | (launched: 2022-12-09_01:56:07.247945) | Connection to 10.42.42.116 closed. 01:56:09.522477 run rm-remote-dir(pid=9413): Terminating (SIGINT) 01:56:09.714933 run rm-remote-dir(pid=9413): Terminated: ok {rc=0} 01:56:09.853990 tst handover.py:37: ERR: Error: srsepc(pid=9412): Process ended prematurely: srsepc(pid=9412) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9412)] [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 01:56:09.864780 tst handover.py:37: Test FAILED (20.0 sec) 01:56:09.946477 run scp-back-log(pid=9414): Launched 01:56:11.030124 run scp-back-log(pid=9414): ERR: Terminated: ERROR {rc=1} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9414)] 01:56:11.092361 run scp-back-log(pid=9414): stdout: | (launched: 2022-12-09_01:56:09.914132) 01:56:11.155322 run scp-back-log(pid=9414): stderr: | (launched: 2022-12-09_01:56:09.935067) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:56:11.226087 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9414): launch_sync(): local process exited with status 1 [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9414)]') ---------------------------------------------- trial-2352 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 01:56:11.272104 tst iperf3_bidir.py:13: Number of physical ue: 1 01:56:11.480514 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:56:11.522795 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 01:56:11.730098 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:56:11.745888 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:56:11.778588 tst iperf3_bidir.py: using MSISDN 6971 01:56:11.899748 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6971', subscriber_id=0} 01:56:12.016364 run srsepc_10.42.42.118: Starting srsepc 01:56:12.698049 run rm-remote-dir(pid=9416): Launched 01:56:13.892848 run rm-remote-dir(pid=9416): Terminated: ok {rc=0} 01:56:14.256594 run mk-remote-dir(pid=9417): Launched 01:56:15.451487 run mk-remote-dir(pid=9417): Terminated: ok {rc=0} 01:56:15.761449 run scp-inst-to-remote(pid=9418): Launched 01:56:17.974633 run scp-inst-to-remote(pid=9418): Terminated: ok {rc=0} 01:56:18.337417 run rm-remote-dir(pid=9420): Launched 01:56:19.533891 run rm-remote-dir(pid=9420): Terminated: ok {rc=0} 01:56:19.897879 run mk-remote-dir(pid=9421): Launched 01:56:21.094158 run mk-remote-dir(pid=9421): Terminated: ok {rc=0} 01:56:21.403526 run scp-cfg-to-remote(pid=9422): Launched 01:56:22.604387 run scp-cfg-to-remote(pid=9422): Terminated: ok {rc=0} 01:56:22.892553 run scp-db-to-remote(pid=9424): Launched 01:56:24.072821 run scp-db-to-remote(pid=9424): Terminated: ok {rc=0} 01:56:24.205988 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:56:24.519053 run patchelf(pid=9426): Launched 01:56:25.699544 run patchelf(pid=9426): Terminated: ok {rc=0} 01:56:25.833103 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:56:26.145198 run setcap-netadm(pid=9427): Launched 01:56:27.323300 run setcap-netadm(pid=9427): Terminated: ok {rc=0} 01:56:27.650915 run srsepc(pid=9428): Launched 01:56:27.766252 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:56:28.879806 run rm-remote-dir(pid=9429): Launched 01:56:29.057309 run srsepc(pid=9428): ERR: Terminated: ERROR {rc=127} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9428)] 01:56:29.192685 run srsepc(pid=9428): stdout: | (launched: 2022-12-09_01:56:27.593942) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:29.329606 run srsepc(pid=9428): stderr: | (launched: 2022-12-09_01:56:27.640084) | Connection to 10.42.42.116 closed. 01:56:29.466558 run srsepc(pid=9428): stdout: | (launched: 2022-12-09_01:56:27.593942) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:29.597185 run srsepc(pid=9428): stderr: | (launched: 2022-12-09_01:56:27.640084) | Connection to 10.42.42.116 closed. 01:56:29.751605 run rm-remote-dir(pid=9429): Terminating (SIGINT) 01:56:29.931095 run rm-remote-dir(pid=9429): Terminated: ok {rc=0} 01:56:30.061091 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=9428): Process ended prematurely: srsepc(pid=9428) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9428)] [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 01:56:30.071155 tst iperf3_bidir.py:42: Test FAILED (18.8 sec) 01:56:30.149515 run scp-back-log(pid=9430): Launched 01:56:31.225192 run scp-back-log(pid=9430): ERR: Terminated: ERROR {rc=1} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9430)] 01:56:31.290328 run scp-back-log(pid=9430): stdout: | (launched: 2022-12-09_01:56:30.118642) 01:56:31.356102 run scp-back-log(pid=9430): stderr: | (launched: 2022-12-09_01:56:30.138497) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:56:31.429761 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9430): launch_sync(): local process exited with status 1 [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9430)]') ---------------------------------------------- trial-2352 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 01:56:31.479648 tst iperf3_dl.py:13: Number of physical ue: 1 01:56:31.695704 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:56:31.741516 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 01:56:32.013180 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:56:32.030757 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:56:32.064259 tst iperf3_dl.py: using MSISDN 6972 01:56:32.198003 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6972', subscriber_id=0} 01:56:32.315143 run srsepc_10.42.42.118: Starting srsepc 01:56:32.995374 run rm-remote-dir(pid=9432): Launched 01:56:34.192025 run rm-remote-dir(pid=9432): Terminated: ok {rc=0} 01:56:34.555627 run mk-remote-dir(pid=9433): Launched 01:56:35.748504 run mk-remote-dir(pid=9433): Terminated: ok {rc=0} 01:56:36.057691 run scp-inst-to-remote(pid=9434): Launched 01:56:38.252251 run scp-inst-to-remote(pid=9434): Terminated: ok {rc=0} 01:56:38.614003 run rm-remote-dir(pid=9436): Launched 01:56:39.808286 run rm-remote-dir(pid=9436): Terminated: ok {rc=0} 01:56:40.171462 run mk-remote-dir(pid=9437): Launched 01:56:41.366539 run mk-remote-dir(pid=9437): Terminated: ok {rc=0} 01:56:41.676729 run scp-cfg-to-remote(pid=9438): Launched 01:56:42.867988 run scp-cfg-to-remote(pid=9438): Terminated: ok {rc=0} 01:56:43.175176 run scp-db-to-remote(pid=9440): Launched 01:56:44.367598 run scp-db-to-remote(pid=9440): Terminated: ok {rc=0} 01:56:44.509866 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:56:44.844812 run patchelf(pid=9442): Launched 01:56:46.040696 run patchelf(pid=9442): Terminated: ok {rc=0} 01:56:46.187217 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:56:46.530270 run setcap-netadm(pid=9443): Launched 01:56:47.777083 run setcap-netadm(pid=9443): Terminated: ok {rc=0} 01:56:48.126741 run srsepc(pid=9444): Launched 01:56:48.253214 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:56:49.374695 run rm-remote-dir(pid=9445): Launched 01:56:49.552371 run srsepc(pid=9444): ERR: Terminated: ERROR {rc=127} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9444)] 01:56:49.687760 run srsepc(pid=9444): stdout: | (launched: 2022-12-09_01:56:48.066431) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:49.824792 run srsepc(pid=9444): stderr: | (launched: 2022-12-09_01:56:48.115619) | Connection to 10.42.42.116 closed. 01:56:49.961558 run srsepc(pid=9444): stdout: | (launched: 2022-12-09_01:56:48.066431) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:50.092478 run srsepc(pid=9444): stderr: | (launched: 2022-12-09_01:56:48.115619) | Connection to 10.42.42.116 closed. 01:56:50.247192 run rm-remote-dir(pid=9445): Terminating (SIGINT) 01:56:50.426081 run rm-remote-dir(pid=9445): Terminated: ok {rc=0} 01:56:50.555694 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=9444): Process ended prematurely: srsepc(pid=9444) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9444)] [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 01:56:50.565907 tst iperf3_dl.py:42: Test FAILED (19.1 sec) 01:56:50.644249 run scp-back-log(pid=9446): Launched 01:56:51.721841 run scp-back-log(pid=9446): ERR: Terminated: ERROR {rc=1} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9446)] 01:56:51.783147 run scp-back-log(pid=9446): stdout: | (launched: 2022-12-09_01:56:50.613488) 01:56:51.846109 run scp-back-log(pid=9446): stderr: | (launched: 2022-12-09_01:56:50.633387) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:56:51.916803 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9446): launch_sync(): local process exited with status 1 [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9446)]') ---------------------------------------------- trial-2352 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 01:56:51.962414 tst iperf3_ul.py:13: Number of physical ue: 1 01:56:52.170883 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:56:52.213601 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 01:56:52.419352 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:56:52.435231 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:56:52.468466 tst iperf3_ul.py: using MSISDN 6973 01:56:52.579743 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6973', subscriber_id=0} 01:56:52.687318 run srsepc_10.42.42.118: Starting srsepc 01:56:53.319583 run rm-remote-dir(pid=9448): Launched 01:56:54.500433 run rm-remote-dir(pid=9448): Terminated: ok {rc=0} 01:56:54.841678 run mk-remote-dir(pid=9449): Launched 01:56:56.023902 run mk-remote-dir(pid=9449): Terminated: ok {rc=0} 01:56:56.314269 run scp-inst-to-remote(pid=9450): Launched 01:56:58.495093 run scp-inst-to-remote(pid=9450): Terminated: ok {rc=0} 01:56:58.834382 run rm-remote-dir(pid=9452): Launched 01:57:00.015740 run rm-remote-dir(pid=9452): Terminated: ok {rc=0} 01:57:00.355684 run mk-remote-dir(pid=9453): Launched 01:57:01.540548 run mk-remote-dir(pid=9453): Terminated: ok {rc=0} 01:57:01.860630 run scp-cfg-to-remote(pid=9454): Launched 01:57:03.099054 run scp-cfg-to-remote(pid=9454): Terminated: ok {rc=0} 01:57:03.406676 run scp-db-to-remote(pid=9456): Launched 01:57:04.597567 run scp-db-to-remote(pid=9456): Terminated: ok {rc=0} 01:57:04.739237 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:57:05.075379 run patchelf(pid=9458): Launched 01:57:06.268207 run patchelf(pid=9458): Terminated: ok {rc=0} 01:57:06.411272 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:57:06.747115 run setcap-netadm(pid=9459): Launched 01:57:07.941876 run setcap-netadm(pid=9459): Terminated: ok {rc=0} 01:57:08.292743 run srsepc(pid=9460): Launched 01:57:08.418358 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:57:09.547082 run rm-remote-dir(pid=9461): Launched 01:57:09.726966 run srsepc(pid=9460): ERR: Terminated: ERROR {rc=127} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9460)] 01:57:09.862984 run srsepc(pid=9460): stdout: | (launched: 2022-12-09_01:57:08.231875) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:09.999757 run srsepc(pid=9460): stderr: | (launched: 2022-12-09_01:57:08.281620) | Connection to 10.42.42.116 closed. 01:57:10.136744 run srsepc(pid=9460): stdout: | (launched: 2022-12-09_01:57:08.231875) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:10.268017 run srsepc(pid=9460): stderr: | (launched: 2022-12-09_01:57:08.281620) | Connection to 10.42.42.116 closed. 01:57:10.423733 run rm-remote-dir(pid=9461): Terminating (SIGINT) 01:57:10.604136 run rm-remote-dir(pid=9461): Terminated: ok {rc=0} 01:57:10.733879 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=9460): Process ended prematurely: srsepc(pid=9460) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9460)] [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 01:57:10.744049 tst iperf3_ul.py:42: Test FAILED (18.8 sec) 01:57:10.822140 run scp-back-log(pid=9462): Launched 01:57:11.899346 run scp-back-log(pid=9462): ERR: Terminated: ERROR {rc=1} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9462)] 01:57:11.961098 run scp-back-log(pid=9462): stdout: | (launched: 2022-12-09_01:57:10.791234) 01:57:12.023914 run scp-back-log(pid=9462): stderr: | (launched: 2022-12-09_01:57:10.810974) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:57:12.094911 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9462): launch_sync(): local process exited with status 1 [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9462)]') ---------------------------------------------- trial-2352 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 01:57:12.141668 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:57:12.158380 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:57:12.181443 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:57:12.236483 tst ping.py: using MSISDN 6974 01:57:12.351165 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6974', subscriber_id=0} 01:57:12.459495 run srsepc_10.42.42.118: Starting srsepc 01:57:13.095793 run rm-remote-dir(pid=9464): Launched 01:57:14.276837 run rm-remote-dir(pid=9464): Terminated: ok {rc=0} 01:57:14.616270 run mk-remote-dir(pid=9465): Launched 01:57:15.796189 run mk-remote-dir(pid=9465): Terminated: ok {rc=0} 01:57:16.129065 run scp-inst-to-remote(pid=9466): Launched 01:57:18.436160 run scp-inst-to-remote(pid=9466): Terminated: ok {rc=0} 01:57:18.797888 run rm-remote-dir(pid=9468): Launched 01:57:19.992931 run rm-remote-dir(pid=9468): Terminated: ok {rc=0} 01:57:20.356256 run mk-remote-dir(pid=9469): Launched 01:57:21.551366 run mk-remote-dir(pid=9469): Terminated: ok {rc=0} 01:57:21.860405 run scp-cfg-to-remote(pid=9470): Launched 01:57:23.051978 run scp-cfg-to-remote(pid=9470): Terminated: ok {rc=0} 01:57:23.359098 run scp-db-to-remote(pid=9472): Launched 01:57:24.555802 run scp-db-to-remote(pid=9472): Terminated: ok {rc=0} 01:57:24.698057 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:57:25.031607 run patchelf(pid=9474): Launched 01:57:26.222809 run patchelf(pid=9474): Terminated: ok {rc=0} 01:57:26.364532 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:57:26.699317 run setcap-netadm(pid=9475): Launched 01:57:27.891166 run setcap-netadm(pid=9475): Terminated: ok {rc=0} 01:57:28.239941 run srsepc(pid=9476): Launched 01:57:28.364344 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:57:29.561905 run rm-remote-dir(pid=9477): Launched 01:57:29.753823 run srsepc(pid=9476): ERR: Terminated: ERROR {rc=127} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9476)] 01:57:29.900076 run srsepc(pid=9476): stdout: | (launched: 2022-12-09_01:57:28.179285) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:30.045847 run srsepc(pid=9476): stderr: | (launched: 2022-12-09_01:57:28.228732) | Connection to 10.42.42.116 closed. 01:57:30.191354 run srsepc(pid=9476): stdout: | (launched: 2022-12-09_01:57:28.179285) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:30.331390 run srsepc(pid=9476): stderr: | (launched: 2022-12-09_01:57:28.228732) | Connection to 10.42.42.116 closed. 01:57:30.497829 run rm-remote-dir(pid=9477): Terminating (SIGINT) 01:57:30.689520 run rm-remote-dir(pid=9477): Terminated: ok {rc=0} 01:57:30.827536 tst ping.py:16: ERR: Error: srsepc(pid=9476): Process ended prematurely: srsepc(pid=9476) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9476)] [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 01:57:30.842610 tst ping.py:16: Test FAILED (18.7 sec) 01:57:30.944380 run scp-back-log(pid=9478): Launched 01:57:32.059377 run scp-back-log(pid=9478): ERR: Terminated: ERROR {rc=1} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9478)] 01:57:32.138501 run scp-back-log(pid=9478): stdout: | (launched: 2022-12-09_01:57:30.902230) 01:57:32.206107 run scp-back-log(pid=9478): stderr: | (launched: 2022-12-09_01:57:30.929041) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:57:32.281632 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9478): launch_sync(): local process exited with status 1 [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9478)]') ---------------------------------------------- trial-2352 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 01:57:32.330895 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:57:32.348664 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:57:32.372259 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:57:32.424431 tst rrc_idle_mo_ping.py: using MSISDN 6975 01:57:32.547717 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6975', subscriber_id=0} 01:57:32.663802 run srsepc_10.42.42.118: Starting srsepc 01:57:33.343113 run rm-remote-dir(pid=9480): Launched 01:57:34.537210 run rm-remote-dir(pid=9480): Terminated: ok {rc=0} 01:57:34.899483 run mk-remote-dir(pid=9481): Launched 01:57:36.095313 run mk-remote-dir(pid=9481): Terminated: ok {rc=0} 01:57:36.404537 run scp-inst-to-remote(pid=9484): Launched 01:57:38.598073 run scp-inst-to-remote(pid=9484): Terminated: ok {rc=0} 01:57:38.941688 run rm-remote-dir(pid=9486): Launched 01:57:40.122491 run rm-remote-dir(pid=9486): Terminated: ok {rc=0} 01:57:40.462045 run mk-remote-dir(pid=9487): Launched 01:57:41.643049 run mk-remote-dir(pid=9487): Terminated: ok {rc=0} 01:57:41.933030 run scp-cfg-to-remote(pid=9488): Launched 01:57:43.110870 run scp-cfg-to-remote(pid=9488): Terminated: ok {rc=0} 01:57:43.399679 run scp-db-to-remote(pid=9490): Launched 01:57:44.578898 run scp-db-to-remote(pid=9490): Terminated: ok {rc=0} 01:57:44.711823 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:57:45.022758 run patchelf(pid=9492): Launched 01:57:46.218288 run patchelf(pid=9492): Terminated: ok {rc=0} 01:57:46.397466 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:57:46.808209 run setcap-netadm(pid=9493): Launched 01:57:48.094636 run setcap-netadm(pid=9493): Terminated: ok {rc=0} 01:57:48.444244 run srsepc(pid=9494): Launched 01:57:48.572249 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:57:49.768679 run rm-remote-dir(pid=9495): Launched 01:57:49.961368 run srsepc(pid=9494): ERR: Terminated: ERROR {rc=127} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9494)] 01:57:50.107740 run srsepc(pid=9494): stdout: | (launched: 2022-12-09_01:57:48.383579) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:50.253933 run srsepc(pid=9494): stderr: | (launched: 2022-12-09_01:57:48.432850) | Connection to 10.42.42.116 closed. 01:57:50.399842 run srsepc(pid=9494): stdout: | (launched: 2022-12-09_01:57:48.383579) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:50.540253 run srsepc(pid=9494): stderr: | (launched: 2022-12-09_01:57:48.432850) | Connection to 10.42.42.116 closed. 01:57:50.706069 run rm-remote-dir(pid=9495): Terminating (SIGINT) 01:57:50.897935 run rm-remote-dir(pid=9495): Terminated: ok {rc=0} 01:57:51.036701 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=9494): Process ended prematurely: srsepc(pid=9494) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9494)] [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 01:57:51.047634 tst rrc_idle_mo_ping.py:16: Test FAILED (18.7 sec) 01:57:51.129732 run scp-back-log(pid=9496): Launched 01:57:52.210603 run scp-back-log(pid=9496): ERR: Terminated: ERROR {rc=1} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9496)] 01:57:52.275273 run scp-back-log(pid=9496): stdout: | (launched: 2022-12-09_01:57:51.097548) 01:57:52.341516 run scp-back-log(pid=9496): stderr: | (launched: 2022-12-09_01:57:51.118571) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:57:52.416049 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9496): launch_sync(): local process exited with status 1 [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9496)]') ---------------------------------------------- trial-2352 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 01:57:52.465174 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:57:52.482689 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:57:52.506210 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:57:52.556758 tst rrc_idle_mt_ping.py: using MSISDN 6976 01:57:52.679777 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6976', subscriber_id=0} 01:57:52.796539 run srsepc_10.42.42.118: Starting srsepc 01:57:53.478762 run rm-remote-dir(pid=9498): Launched 01:57:54.675063 run rm-remote-dir(pid=9498): Terminated: ok {rc=0} 01:57:55.039463 run mk-remote-dir(pid=9499): Launched 01:57:56.235440 run mk-remote-dir(pid=9499): Terminated: ok {rc=0} 01:57:56.546775 run scp-inst-to-remote(pid=9500): Launched 01:57:58.741481 run scp-inst-to-remote(pid=9500): Terminated: ok {rc=0} 01:57:59.104144 run rm-remote-dir(pid=9502): Launched 01:58:00.298559 run rm-remote-dir(pid=9502): Terminated: ok {rc=0} 01:58:00.663283 run mk-remote-dir(pid=9503): Launched 01:58:01.858189 run mk-remote-dir(pid=9503): Terminated: ok {rc=0} 01:58:02.174502 run scp-cfg-to-remote(pid=9504): Launched 01:58:03.387901 run scp-cfg-to-remote(pid=9504): Terminated: ok {rc=0} 01:58:03.677399 run scp-db-to-remote(pid=9506): Launched 01:58:04.856854 run scp-db-to-remote(pid=9506): Terminated: ok {rc=0} 01:58:04.989975 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:58:05.303244 run patchelf(pid=9508): Launched 01:58:06.483030 run patchelf(pid=9508): Terminated: ok {rc=0} 01:58:06.617249 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:58:06.930062 run setcap-netadm(pid=9509): Launched 01:58:08.109747 run setcap-netadm(pid=9509): Terminated: ok {rc=0} 01:58:08.438547 run srsepc(pid=9510): Launched 01:58:08.556418 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:58:09.677674 run rm-remote-dir(pid=9511): Launched 01:58:09.856518 run srsepc(pid=9510): ERR: Terminated: ERROR {rc=127} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9510)] 01:58:09.993138 run srsepc(pid=9510): stdout: | (launched: 2022-12-09_01:58:08.381294) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:58:10.130407 run srsepc(pid=9510): stderr: | (launched: 2022-12-09_01:58:08.427422) | Connection to 10.42.42.116 closed. 01:58:10.267423 run srsepc(pid=9510): stdout: | (launched: 2022-12-09_01:58:08.381294) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:58:10.398896 run srsepc(pid=9510): stderr: | (launched: 2022-12-09_01:58:08.427422) | Connection to 10.42.42.116 closed. 01:58:10.555095 run rm-remote-dir(pid=9511): Terminating (SIGINT) 01:58:10.735622 run rm-remote-dir(pid=9511): Terminated: ok {rc=0} 01:58:10.866535 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=9510): Process ended prematurely: srsepc(pid=9510) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9510)] [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 01:58:10.876748 tst rrc_idle_mt_ping.py:16: Test FAILED (18.4 sec) 01:58:10.955068 run scp-back-log(pid=9512): Launched 01:58:12.035094 run scp-back-log(pid=9512): ERR: Terminated: ERROR {rc=1} [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9512)] 01:58:12.097710 run scp-back-log(pid=9512): stdout: | (launched: 2022-12-09_01:58:10.924112) 01:58:12.160844 run scp-back-log(pid=9512): stderr: | (launched: 2022-12-09_01:58:10.943979) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:58:12.231792 tst srsepc_10.42.42.118: Error('scp-back-log(pid=9512): launch_sync(): local process exited with status 1 [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=9512)]') --------------------------------------------------------------------- trial-2352 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 01:58:12.361972 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:12.367049 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 01:58:12.408390 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 01:58:12.434975 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 01:58:12.490744 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 01:58:12.533511 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 01:58:12.559565 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 01:58:13.103509 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 01:58:13.108869 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:58:13.119705 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 01:58:13.158428 tst handover.py: using LAC 18265 01:58:13.280652 tst handover.py: using RAC 160 01:58:13.400101 tst handover.py: using CellId 18265 01:58:13.518244 tst handover.py: using BVCI 18266 01:58:13.630094 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 01:58:13.663128 tst handover.py: using LAC 18266 01:58:13.781798 tst handover.py: using RAC 161 01:58:13.899903 tst handover.py: using CellId 18266 01:58:14.019209 tst handover.py: using BVCI 18267 01:58:14.140281 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:58:14.151826 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:58:14.163070 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:58:14.174518 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:58:14.186028 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:58:14.197392 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 01:58:14.312173 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 01:58:14.431487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:14.938908 run create_hlr_db(pid=9517): Launched 01:58:16.121652 run create_hlr_db(pid=9517): Terminated: ok {rc=0} 01:58:16.481183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9519): Launched 01:58:16.829130 run osmo-hlr_10.42.42.2(pid=9520): Launched 01:58:17.119814 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:17.688203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9522): Launched 01:58:17.993504 run osmo-stp_10.42.42.5(pid=9523): Launched 01:58:18.110931 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:18.665034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9525): Launched 01:58:18.970413 run osmo-msc_10.42.42.6(pid=9526): Launched 01:58:19.143522 run osmo-stp_10.42.42.5(pid=9523): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9523)] 01:58:19.274355 run osmo-stp_10.42.42.5(pid=9523): stdout: | (launched: 2022-12-09_01:58:17.937257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:19.403893 run osmo-stp_10.42.42.5(pid=9523): stderr: | 20221209015818110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015818110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015818110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015818111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015818111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015818111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015818111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:19.531772 run osmo-stp_10.42.42.5(pid=9523): stdout: | (launched: 2022-12-09_01:58:17.937257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:19.653253 run osmo-stp_10.42.42.5(pid=9523): stderr: | 20221209015818110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015818110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015818110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015818111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015818111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015818111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015818111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:19.798401 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9523): Process ended prematurely: osmo-stp_10.42.42.5(pid=9523) [trial-2352↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9523)] [trial-2352↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 01:58:19.806775 tst handover.py:18: Test FAILED (6.7 sec) 01:58:19.833603 run osmo-hlr_10.42.42.2(pid=9520): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9520)] 01:58:19.882596 run osmo-hlr_10.42.42.2(pid=9520): stdout: | (launched: 2022-12-09_01:58:16.767366) 01:58:19.932878 run osmo-hlr_10.42.42.2(pid=9520): stderr: | 20221209015816957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015816957 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015816957 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015816957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015816957 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015816957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015816970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015816983 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015816984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015816984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:20.002954 run osmo-msc_10.42.42.6(pid=9526): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9526)] 01:58:20.051176 run osmo-msc_10.42.42.6(pid=9526): stdout: | (launched: 2022-12-09_01:58:18.914281) 01:58:20.101210 run osmo-msc_10.42.42.6(pid=9526): stderr: | 20221209015819183 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015819183 DLGLOBAL DEBUG validating counter group 0x7fdfa02e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015819183 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015819183 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015819183 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015819184 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015819185 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015819186 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015819186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015819186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:20.151627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9519): Terminating (SIGTERM) 01:58:20.192008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9522): Terminating (SIGTERM) 01:58:20.232426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9525): Terminating (SIGTERM) 01:58:20.273071 --- ParallelTerminationStrategy: PID 9519 died... 01:58:20.292249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9519): Terminated: ok {rc=0} 01:58:20.337181 --- ParallelTerminationStrategy: PID 9522 died... 01:58:20.355960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9522): Terminated: ok {rc=0} 01:58:20.401196 --- ParallelTerminationStrategy: PID 9525 died... 01:58:20.419936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9525): Terminated: ok {rc=0} 01:58:20.507625 bus /sierra_3: Setting Powered False 01:58:21.606860 bus /sierra_3: Setting Powered False 01:58:22.723209 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 01:58:23.972918 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:23.978584 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 01:58:24.019225 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 01:58:24.046652 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 01:58:24.100099 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 01:58:24.141488 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 01:58:24.168279 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 01:58:24.721538 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 01:58:24.726879 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:24.738220 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 01:58:24.776847 tst handover.py: using LAC 18267 01:58:24.903966 tst handover.py: using RAC 162 01:58:25.031048 tst handover.py: using CellId 18267 01:58:25.163034 tst handover.py: using BVCI 18268 01:58:25.282790 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 01:58:25.316152 tst handover.py: using LAC 18268 01:58:25.444734 tst handover.py: using RAC 163 01:58:25.572503 tst handover.py: using CellId 18268 01:58:25.699222 tst handover.py: using BVCI 18269 01:58:25.818025 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:25.829422 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:25.840534 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:25.851638 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:25.862797 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:25.873830 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 01:58:25.988653 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 01:58:26.103795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:26.549837 run create_hlr_db(pid=9531): Launched 01:58:26.676056 bus /sierra_2: Setting Powered False 01:58:27.736381 run create_hlr_db(pid=9531): Terminated: ok {rc=0} 01:58:28.155340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9533): Launched 01:58:28.483688 run osmo-hlr_10.42.42.2(pid=9534): Launched 01:58:28.610488 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:29.151394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9536): Launched 01:58:29.479813 run osmo-stp_10.42.42.5(pid=9537): Launched 01:58:29.607792 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:30.172004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9539): Launched 01:58:30.501759 run osmo-msc_10.42.42.6(pid=9540): Launched 01:58:30.685483 run osmo-stp_10.42.42.5(pid=9537): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9537)] 01:58:30.823428 run osmo-stp_10.42.42.5(pid=9537): stdout: | (launched: 2022-12-09_01:58:29.419686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:31.063471 run osmo-stp_10.42.42.5(pid=9537): stderr: | 20221209015829613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015829614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015829614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015829614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015829615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015829615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015829615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:31.240457 run osmo-stp_10.42.42.5(pid=9537): stdout: | (launched: 2022-12-09_01:58:29.419686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:31.373474 run osmo-stp_10.42.42.5(pid=9537): stderr: | 20221209015829613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015829614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015829614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015829614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015829615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015829615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015829615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:31.534315 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9537): Process ended prematurely: osmo-stp_10.42.42.5(pid=9537) [trial-2352↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9537)] [trial-2352↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 01:58:31.543840 tst handover.py:18: Test FAILED (6.8 sec) 01:58:31.573040 run osmo-hlr_10.42.42.2(pid=9534): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9534)] 01:58:31.625605 run osmo-hlr_10.42.42.2(pid=9534): stdout: | (launched: 2022-12-09_01:58:28.423165) 01:58:31.679170 run osmo-hlr_10.42.42.2(pid=9534): stderr: | 20221209015828624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015828624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015828624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015828624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015828624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015828624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015828637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015828647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015828647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015828647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:31.753738 run osmo-msc_10.42.42.6(pid=9540): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9540)] 01:58:31.805784 run osmo-msc_10.42.42.6(pid=9540): stdout: | (launched: 2022-12-09_01:58:30.440853) 01:58:31.859481 run osmo-msc_10.42.42.6(pid=9540): stderr: | 20221209015830765 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015830765 DLGLOBAL DEBUG validating counter group 0x7faebb251c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015830765 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015830765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015830766 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015830766 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015830767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015830768 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015830768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015830768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:31.932783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9533): Terminating (SIGTERM) 01:58:31.988503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9536): Terminating (SIGTERM) 01:58:32.036002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9539): Terminating (SIGTERM) 01:58:32.079686 --- ParallelTerminationStrategy: PID 9533 died... 01:58:32.099941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9533): Terminated: ok {rc=0} 01:58:32.147672 --- ParallelTerminationStrategy: PID 9536 died... 01:58:32.167943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9536): Terminated: ok {rc=0} 01:58:32.215090 --- ParallelTerminationStrategy: PID 9539 died... 01:58:32.235445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9539): Terminated: ok {rc=0} 01:58:32.325916 bus /sierra_3: Setting Powered False 01:58:33.427390 bus /sierra_3: Setting Powered False 01:58:34.545287 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 01:58:35.788504 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:35.793933 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 01:58:35.847578 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 01:58:35.874235 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 01:58:35.926494 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 01:58:35.980400 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 01:58:36.006583 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 01:58:36.554851 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 01:58:36.560158 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:36.570989 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:58:36.608394 tst handover.py: using LAC 18269 01:58:36.727763 tst handover.py: using RAC 164 01:58:36.849312 tst handover.py: using CellId 18269 01:58:36.970873 tst handover.py: using BVCI 18270 01:58:37.083074 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:58:37.131081 tst handover.py: using LAC 18270 01:58:37.254582 tst handover.py: using RAC 165 01:58:37.374252 tst handover.py: using CellId 18270 01:58:37.497895 tst handover.py: using BVCI 18271 01:58:37.610022 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:37.620740 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:37.631416 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:37.642224 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:37.653185 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:37.663981 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:58:37.783792 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:58:37.903924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:38.382353 run create_hlr_db(pid=9545): Launched 01:58:38.515756 bus /sierra_2: Setting Powered False 01:58:39.581204 run create_hlr_db(pid=9545): Terminated: ok {rc=0} 01:58:40.009204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9547): Launched 01:58:40.338150 run osmo-hlr_10.42.42.2(pid=9548): Launched 01:58:40.463710 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:41.001266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9550): Launched 01:58:41.329535 run osmo-stp_10.42.42.5(pid=9551): Launched 01:58:41.455027 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:42.021594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9553): Launched 01:58:42.350741 run osmo-msc_10.42.42.6(pid=9554): Launched 01:58:42.535378 run osmo-stp_10.42.42.5(pid=9551): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9551)] 01:58:42.692770 run osmo-stp_10.42.42.5(pid=9551): stdout: | (launched: 2022-12-09_01:58:41.269263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:42.836101 run osmo-stp_10.42.42.5(pid=9551): stderr: | 20221209015841463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015841463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015841463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015841464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015841465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015841465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015841465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:42.971999 run osmo-stp_10.42.42.5(pid=9551): stdout: | (launched: 2022-12-09_01:58:41.269263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:43.102299 run osmo-stp_10.42.42.5(pid=9551): stderr: | 20221209015841463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015841463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015841463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015841464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015841465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015841465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015841465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:43.257946 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9551): Process ended prematurely: osmo-stp_10.42.42.5(pid=9551) [trial-2352↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9551)] [trial-2352↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 01:58:43.267270 tst handover.py:18: Test FAILED (6.7 sec) 01:58:43.295330 run osmo-hlr_10.42.42.2(pid=9548): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9548)] 01:58:43.346161 run osmo-hlr_10.42.42.2(pid=9548): stdout: | (launched: 2022-12-09_01:58:40.277804) 01:58:43.398533 run osmo-hlr_10.42.42.2(pid=9548): stderr: | 20221209015840479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015840479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015840479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015840479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015840479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015840479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015840492 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015840501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015840501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015840501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:43.471647 run osmo-msc_10.42.42.6(pid=9554): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9554)] 01:58:43.522318 run osmo-msc_10.42.42.6(pid=9554): stdout: | (launched: 2022-12-09_01:58:42.290773) 01:58:43.574597 run osmo-msc_10.42.42.6(pid=9554): stderr: | 20221209015842613 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015842614 DLGLOBAL DEBUG validating counter group 0x7f906262ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015842614 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015842614 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015842614 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015842614 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015842616 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015842616 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015842616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015842616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:43.627596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9547): Terminating (SIGTERM) 01:58:43.670116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9550): Terminating (SIGTERM) 01:58:43.712617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9553): Terminating (SIGTERM) 01:58:43.755555 --- ParallelTerminationStrategy: PID 9547 died... 01:58:43.775695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9547): Terminated: ok {rc=0} 01:58:43.822884 --- ParallelTerminationStrategy: PID 9550 died... 01:58:43.842774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9550): Terminated: ok {rc=0} 01:58:43.889382 --- ParallelTerminationStrategy: PID 9553 died... 01:58:43.909173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9553): Terminated: ok {rc=0} 01:58:43.997814 bus /sierra_3: Setting Powered False 01:58:45.097662 bus /sierra_3: Setting Powered False 01:58:46.216860 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 01:58:47.485584 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:47.490912 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 01:58:47.543830 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:58:47.571552 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 01:58:47.624920 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 01:58:47.676608 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:58:47.704061 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 01:58:48.257029 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 01:58:48.262735 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:48.274483 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 01:58:48.314046 tst handover.py: using LAC 18271 01:58:48.437192 tst handover.py: using RAC 166 01:58:48.558735 tst handover.py: using CellId 18271 01:58:48.679859 tst handover.py: using BVCI 18272 01:58:48.792415 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 01:58:48.836669 tst handover.py: using LAC 18272 01:58:48.957370 tst handover.py: using RAC 167 01:58:49.078946 tst handover.py: using CellId 18272 01:58:49.199425 tst handover.py: using BVCI 18273 01:58:49.311294 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:49.322493 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:49.333512 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:49.344752 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:49.355971 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:49.367115 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:58:49.483494 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:58:49.603249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:50.082053 run create_hlr_db(pid=9559): Launched 01:58:50.216469 bus /sierra_2: Setting Powered False 01:58:51.281184 run create_hlr_db(pid=9559): Terminated: ok {rc=0} 01:58:51.709138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9561): Launched 01:58:52.037197 run osmo-hlr_10.42.42.2(pid=9562): Launched 01:58:52.161874 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:52.700308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9564): Launched 01:58:53.027345 run osmo-stp_10.42.42.5(pid=9565): Launched 01:58:53.153898 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:53.721191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9567): Launched 01:58:54.050207 run osmo-msc_10.42.42.6(pid=9568): Launched 01:58:54.233258 run osmo-stp_10.42.42.5(pid=9565): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9565)] 01:58:54.371404 run osmo-stp_10.42.42.5(pid=9565): stdout: | (launched: 2022-12-09_01:58:52.967613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:54.510343 run osmo-stp_10.42.42.5(pid=9565): stderr: | 20221209015853161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015853161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015853161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015853162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015853162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015853162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015853162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:54.648299 run osmo-stp_10.42.42.5(pid=9565): stdout: | (launched: 2022-12-09_01:58:52.967613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:54.779601 run osmo-stp_10.42.42.5(pid=9565): stderr: | 20221209015853161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015853161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015853161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015853162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015853162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015853162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015853162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:54.936059 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9565): Process ended prematurely: osmo-stp_10.42.42.5(pid=9565) [trial-2352↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9565)] [trial-2352↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 01:58:54.945275 tst handover.py:18: Test FAILED (6.7 sec) 01:58:54.973462 run osmo-hlr_10.42.42.2(pid=9562): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9562)] 01:58:55.024363 run osmo-hlr_10.42.42.2(pid=9562): stdout: | (launched: 2022-12-09_01:58:51.976752) 01:58:55.077102 run osmo-hlr_10.42.42.2(pid=9562): stderr: | 20221209015852177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015852177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015852177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015852177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015852177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015852177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015852190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015852198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015852198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015852198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:55.149818 run osmo-msc_10.42.42.6(pid=9568): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9568)] 01:58:55.199899 run osmo-msc_10.42.42.6(pid=9568): stdout: | (launched: 2022-12-09_01:58:53.989730) 01:58:55.251624 run osmo-msc_10.42.42.6(pid=9568): stderr: | 20221209015854313 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015854313 DLGLOBAL DEBUG validating counter group 0x7efe7167ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015854313 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015854313 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015854313 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015854314 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015854317 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015854318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015854318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015854318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:55.303496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9561): Terminating (SIGTERM) 01:58:55.345249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9564): Terminating (SIGTERM) 01:58:55.387020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9567): Terminating (SIGTERM) 01:58:55.429380 --- ParallelTerminationStrategy: PID 9561 died... 01:58:55.449439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9561): Terminated: ok {rc=0} 01:58:55.496525 --- ParallelTerminationStrategy: PID 9564 died... 01:58:55.516358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9564): Terminated: ok {rc=0} 01:58:55.562737 --- ParallelTerminationStrategy: PID 9567 died... 01:58:55.582464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9567): Terminated: ok {rc=0} 01:58:55.672596 bus /sierra_3: Setting Powered False 01:58:56.772124 bus /sierra_3: Setting Powered False 01:58:57.889510 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 01:58:59.145016 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:59.150237 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 01:58:59.204223 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:58:59.231086 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 01:58:59.282094 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 01:58:59.335722 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:58:59.362142 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 01:58:59.919992 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 01:58:59.925574 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:59.936853 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 01:58:59.975756 tst handover.py: using LAC 18273 01:59:00.103203 tst handover.py: using RAC 168 01:59:00.235688 tst handover.py: using CellId 18273 01:59:00.357091 tst handover.py: using BVCI 18274 01:59:00.470032 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 01:59:00.517942 tst handover.py: using LAC 18274 01:59:00.639456 tst handover.py: using RAC 169 01:59:00.767757 tst handover.py: using CellId 18274 01:59:00.918243 tst handover.py: using BVCI 18275 01:59:01.041025 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:01.052714 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:01.064448 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:01.076300 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:01.088022 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:01.099771 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:59:01.221172 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:59:01.367391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:01.908740 run create_hlr_db(pid=9573): Launched 01:59:02.070361 bus /sierra_2: Setting Powered False 01:59:03.134878 run create_hlr_db(pid=9573): Terminated: ok {rc=0} 01:59:03.547652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9575): Launched 01:59:03.857234 run osmo-hlr_10.42.42.2(pid=9576): Launched 01:59:03.974645 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:04.489559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9578): Launched 01:59:04.797613 run osmo-stp_10.42.42.5(pid=9579): Launched 01:59:04.915296 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:05.443335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9581): Launched 01:59:05.749851 run osmo-msc_10.42.42.6(pid=9582): Launched 01:59:05.921448 run osmo-stp_10.42.42.5(pid=9579): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9579)] 01:59:06.050596 run osmo-stp_10.42.42.5(pid=9579): stdout: | (launched: 2022-12-09_01:59:04.741280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:06.179671 run osmo-stp_10.42.42.5(pid=9579): stderr: | 20221209015904912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015904912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015904913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015904913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015904914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015904914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015904914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:06.307355 run osmo-stp_10.42.42.5(pid=9579): stdout: | (launched: 2022-12-09_01:59:04.741280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:06.428573 run osmo-stp_10.42.42.5(pid=9579): stderr: | 20221209015904912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015904912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015904913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015904913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015904914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015904914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015904914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:06.573931 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9579): Process ended prematurely: osmo-stp_10.42.42.5(pid=9579) [trial-2352↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9579)] [trial-2352↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 01:59:06.582383 tst handover.py:18: Test FAILED (6.7 sec) 01:59:06.609459 run osmo-hlr_10.42.42.2(pid=9576): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9576)] 01:59:06.657967 run osmo-hlr_10.42.42.2(pid=9576): stdout: | (launched: 2022-12-09_01:59:03.799496) 01:59:06.707865 run osmo-hlr_10.42.42.2(pid=9576): stderr: | 20221209015903977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015903977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015903977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015903977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015903977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015903977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015903989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015903998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015903998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015903998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:06.777186 run osmo-msc_10.42.42.6(pid=9582): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9582)] 01:59:06.825272 run osmo-msc_10.42.42.6(pid=9582): stdout: | (launched: 2022-12-09_01:59:05.693646) 01:59:06.875153 run osmo-msc_10.42.42.6(pid=9582): stderr: | 20221209015905966 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015905966 DLGLOBAL DEBUG validating counter group 0x7f61fc7f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015905966 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015905966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015905966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015905967 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015905968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015905969 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015905969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015905969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:06.925336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9575): Terminating (SIGTERM) 01:59:06.965345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9578): Terminating (SIGTERM) 01:59:07.005183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9581): Terminating (SIGTERM) 01:59:07.045759 --- ParallelTerminationStrategy: PID 9575 died... 01:59:07.065014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9575): Terminated: ok {rc=0} 01:59:07.110265 --- ParallelTerminationStrategy: PID 9578 died... 01:59:07.129229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9578): Terminated: ok {rc=0} 01:59:07.174427 --- ParallelTerminationStrategy: PID 9581 died... 01:59:07.193262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9581): Terminated: ok {rc=0} 01:59:07.279679 bus /sierra_3: Setting Powered False 01:59:08.378699 bus /sierra_3: Setting Powered False 01:59:09.496372 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 01:59:10.756841 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:10.762379 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 01:59:10.804114 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 01:59:10.830804 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 01:59:10.883170 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 01:59:10.925447 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 01:59:10.952669 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 01:59:11.505159 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 01:59:11.510643 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:11.522242 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 01:59:11.560702 tst handover.py: using LAC 18275 01:59:11.683657 tst handover.py: using RAC 170 01:59:11.805085 tst handover.py: using CellId 18275 01:59:11.927413 tst handover.py: using BVCI 18276 01:59:12.047276 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 01:59:12.083358 tst handover.py: using LAC 18276 01:59:12.213371 tst handover.py: using RAC 171 01:59:12.343216 tst handover.py: using CellId 18276 01:59:12.465860 tst handover.py: using BVCI 18277 01:59:12.579812 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:12.590784 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:12.601570 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:12.612481 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:12.623460 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:12.634216 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 01:59:12.752901 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 01:59:12.870869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:13.350904 run create_hlr_db(pid=9587): Launched 01:59:13.483776 bus /sierra_2: Setting Powered False 01:59:14.548829 run create_hlr_db(pid=9587): Terminated: ok {rc=0} 01:59:14.977701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9589): Launched 01:59:15.305457 run osmo-hlr_10.42.42.2(pid=9590): Launched 01:59:15.431026 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:15.981647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9592): Launched 01:59:16.332805 run osmo-stp_10.42.42.5(pid=9593): Launched 01:59:16.669370 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:17.380358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9595): Launched 01:59:17.709202 run osmo-msc_10.42.42.6(pid=9596): Launched 01:59:17.894169 run osmo-stp_10.42.42.5(pid=9593): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9593)] 01:59:18.031913 run osmo-stp_10.42.42.5(pid=9593): stdout: | (launched: 2022-12-09_01:59:16.270465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:18.170336 run osmo-stp_10.42.42.5(pid=9593): stderr: | 20221209015916556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015916557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015916557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015916557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015916564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015916564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015916565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:18.307498 run osmo-stp_10.42.42.5(pid=9593): stdout: | (launched: 2022-12-09_01:59:16.270465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:18.438252 run osmo-stp_10.42.42.5(pid=9593): stderr: | 20221209015916556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015916557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015916557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015916557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015916564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015916564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015916565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:18.594635 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9593): Process ended prematurely: osmo-stp_10.42.42.5(pid=9593) [trial-2352↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9593)] [trial-2352↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 01:59:18.603698 tst handover.py:18: Test FAILED (7.1 sec) 01:59:18.631679 run osmo-hlr_10.42.42.2(pid=9590): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9590)] 01:59:18.682174 run osmo-hlr_10.42.42.2(pid=9590): stdout: | (launched: 2022-12-09_01:59:15.245220) 01:59:18.734239 run osmo-hlr_10.42.42.2(pid=9590): stderr: | 20221209015915444 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015915444 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015915444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015915444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015915444 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015915444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015915456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015915464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015915465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015915465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:18.806734 run osmo-msc_10.42.42.6(pid=9596): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9596)] 01:59:18.856801 run osmo-msc_10.42.42.6(pid=9596): stdout: | (launched: 2022-12-09_01:59:17.649251) 01:59:18.908437 run osmo-msc_10.42.42.6(pid=9596): stderr: | 20221209015917974 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015917974 DLGLOBAL DEBUG validating counter group 0x7f0bd0e1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015917974 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015917974 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015917974 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015917974 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015917976 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015917976 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015917976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015917977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:18.960383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9589): Terminating (SIGTERM) 01:59:19.002055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9592): Terminating (SIGTERM) 01:59:19.043775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9595): Terminating (SIGTERM) 01:59:19.085917 --- ParallelTerminationStrategy: PID 9589 died... 01:59:19.106010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9589): Terminated: ok {rc=0} 01:59:19.152551 --- ParallelTerminationStrategy: PID 9592 died... 01:59:19.172231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9592): Terminated: ok {rc=0} 01:59:19.218508 --- ParallelTerminationStrategy: PID 9595 died... 01:59:19.238191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9595): Terminated: ok {rc=0} 01:59:19.326265 bus /sierra_3: Setting Powered False 01:59:20.426747 bus /sierra_3: Setting Powered False 01:59:21.543593 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 01:59:22.793807 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:22.799517 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 01:59:22.854616 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 01:59:22.882049 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 01:59:22.934920 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 01:59:22.989246 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 01:59:23.016268 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 01:59:23.568890 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 01:59:23.574766 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:23.586306 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 01:59:23.630917 tst handover.py: using LAC 18277 01:59:23.761351 tst handover.py: using RAC 172 01:59:23.881649 tst handover.py: using CellId 18277 01:59:24.011617 tst handover.py: using BVCI 18278 01:59:24.131732 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 01:59:24.179684 tst handover.py: using LAC 18278 01:59:24.300102 tst handover.py: using RAC 173 01:59:24.418053 tst handover.py: using CellId 18278 01:59:24.537497 tst handover.py: using BVCI 18279 01:59:24.648708 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:24.659722 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:24.670503 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:24.682136 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:24.693853 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:24.705183 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 01:59:24.825414 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 01:59:24.945312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:25.390698 run create_hlr_db(pid=9601): Launched 01:59:25.507531 bus /sierra_2: Setting Powered False 01:59:26.568272 run create_hlr_db(pid=9601): Terminated: ok {rc=0} 01:59:26.986124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Launched 01:59:27.315166 run osmo-hlr_10.42.42.2(pid=9604): Launched 01:59:27.440632 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:27.979471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Launched 01:59:28.309140 run osmo-stp_10.42.42.5(pid=9607): Launched 01:59:28.435380 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:28.999289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9609): Launched 01:59:29.328378 run osmo-msc_10.42.42.6(pid=9610): Launched 01:59:29.511606 run osmo-stp_10.42.42.5(pid=9607): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] 01:59:29.650283 run osmo-stp_10.42.42.5(pid=9607): stdout: | (launched: 2022-12-09_01:59:28.249382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:29.789255 run osmo-stp_10.42.42.5(pid=9607): stderr: | 20221209015928442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015928443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015928443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015928443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015928444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015928444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015928444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:29.925993 run osmo-stp_10.42.42.5(pid=9607): stdout: | (launched: 2022-12-09_01:59:28.249382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:30.056649 run osmo-stp_10.42.42.5(pid=9607): stderr: | 20221209015928442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015928443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015928443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015928443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015928444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015928444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015928444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:30.212119 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9607): Process ended prematurely: osmo-stp_10.42.42.5(pid=9607) [trial-2352↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] [trial-2352↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 01:59:30.221376 tst handover.py:18: Test FAILED (6.6 sec) 01:59:30.248672 run osmo-hlr_10.42.42.2(pid=9604): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9604)] 01:59:30.298656 run osmo-hlr_10.42.42.2(pid=9604): stdout: | (launched: 2022-12-09_01:59:27.255022) 01:59:30.350664 run osmo-hlr_10.42.42.2(pid=9604): stderr: | 20221209015927454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015927454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015927454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015927454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015927454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015927454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015927467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015927477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015927477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015927478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:30.422543 run osmo-msc_10.42.42.6(pid=9610): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9610)] 01:59:30.472226 run osmo-msc_10.42.42.6(pid=9610): stdout: | (launched: 2022-12-09_01:59:29.268391) 01:59:30.524077 run osmo-msc_10.42.42.6(pid=9610): stderr: | 20221209015929590 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015929590 DLGLOBAL DEBUG validating counter group 0x7fc58c759c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015929590 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015929590 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015929591 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015929591 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015929592 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015929593 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015929593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015929593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:30.575954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Terminating (SIGTERM) 01:59:30.617594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Terminating (SIGTERM) 01:59:30.659435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9609): Terminating (SIGTERM) 01:59:30.701743 --- ParallelTerminationStrategy: PID 9603 died... 01:59:30.721719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Terminated: ok {rc=0} 01:59:30.767851 --- ParallelTerminationStrategy: PID 9606 died... 01:59:30.787476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Terminated: ok {rc=0} 01:59:30.833490 --- ParallelTerminationStrategy: PID 9609 died... 01:59:30.853238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9609): Terminated: ok {rc=0} 01:59:30.942648 bus /sierra_3: Setting Powered False 01:59:32.041928 bus /sierra_3: Setting Powered False 01:59:33.159337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 01:59:34.415247 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:34.420234 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 01:59:34.474510 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:59:34.501393 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 01:59:34.553606 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 01:59:34.607496 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:59:34.633469 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 01:59:35.182177 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 01:59:35.187291 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:35.198109 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 01:59:35.240362 tst handover.py: using LAC 18279 01:59:35.359023 tst handover.py: using RAC 174 01:59:35.476820 tst handover.py: using CellId 18279 01:59:35.595532 tst handover.py: using BVCI 18280 01:59:35.706606 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 01:59:35.752819 tst handover.py: using LAC 18280 01:59:35.872791 tst handover.py: using RAC 175 01:59:35.991233 tst handover.py: using CellId 18280 01:59:36.110452 tst handover.py: using BVCI 18281 01:59:36.222732 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:36.233650 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:36.244324 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:36.255735 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:36.267326 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:36.278702 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 01:59:36.399854 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 01:59:36.516672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:36.962792 run create_hlr_db(pid=9616): Launched 01:59:37.079812 bus /sierra_2: Setting Powered False 01:59:38.141259 run create_hlr_db(pid=9616): Terminated: ok {rc=0} 01:59:38.541927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9618): Launched 01:59:38.847539 run osmo-hlr_10.42.42.2(pid=9619): Launched 01:59:38.964306 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:39.479310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9621): Launched 01:59:39.784804 run osmo-stp_10.42.42.5(pid=9622): Launched 01:59:39.902120 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:40.427909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9624): Launched 01:59:40.733527 run osmo-msc_10.42.42.6(pid=9625): Launched 01:59:40.905323 run osmo-stp_10.42.42.5(pid=9622): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9622)] 01:59:41.034791 run osmo-stp_10.42.42.5(pid=9622): stdout: | (launched: 2022-12-09_01:59:39.728610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:41.164106 run osmo-stp_10.42.42.5(pid=9622): stderr: | 20221209015939900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015939901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015939901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015939901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015939902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015939902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015939902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:41.291193 run osmo-stp_10.42.42.5(pid=9622): stdout: | (launched: 2022-12-09_01:59:39.728610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:41.412131 run osmo-stp_10.42.42.5(pid=9622): stderr: | 20221209015939900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015939901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015939901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015939901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015939902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015939902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015939902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:41.557410 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9622): Process ended prematurely: osmo-stp_10.42.42.5(pid=9622) [trial-2352↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9622)] [trial-2352↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 01:59:41.565642 tst handover.py:18: Test FAILED (6.4 sec) 01:59:41.592100 run osmo-hlr_10.42.42.2(pid=9619): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9619)] 01:59:41.640435 run osmo-hlr_10.42.42.2(pid=9619): stdout: | (launched: 2022-12-09_01:59:38.790737) 01:59:41.690207 run osmo-hlr_10.42.42.2(pid=9619): stderr: | 20221209015938968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015938968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015938968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015938968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015938968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015938968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015938980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015938989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015938989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015938989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:41.759221 run osmo-msc_10.42.42.6(pid=9625): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9625)] 01:59:41.807135 run osmo-msc_10.42.42.6(pid=9625): stdout: | (launched: 2022-12-09_01:59:40.677534) 01:59:41.856760 run osmo-msc_10.42.42.6(pid=9625): stderr: | 20221209015940951 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015940951 DLGLOBAL DEBUG validating counter group 0x7f0843028c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015940951 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015940951 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015940951 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015940951 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015940953 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015940954 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015940954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015940954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:41.907087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9618): Terminating (SIGTERM) 01:59:41.946924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9621): Terminating (SIGTERM) 01:59:41.986559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9624): Terminating (SIGTERM) 01:59:42.026389 --- ParallelTerminationStrategy: PID 9618 died... 01:59:42.045254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9618): Terminated: ok {rc=0} 01:59:42.089741 --- ParallelTerminationStrategy: PID 9621 died... 01:59:42.108299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9621): Terminated: ok {rc=0} 01:59:42.152669 --- ParallelTerminationStrategy: PID 9624 died... 01:59:42.171177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9624): Terminated: ok {rc=0} 01:59:42.257463 bus /sierra_3: Setting Powered False 01:59:43.357388 bus /sierra_3: Setting Powered False 01:59:44.474383 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 01:59:45.731554 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:45.736478 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 01:59:45.772883 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 01:59:45.799298 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 01:59:45.853879 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 01:59:45.912388 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 01:59:45.941176 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 01:59:46.494439 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 01:59:46.503443 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:46.520058 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 01:59:46.555976 tst handover.py: using LAC 18281 01:59:46.719721 tst handover.py: using RAC 176 01:59:46.842222 tst handover.py: using CellId 18281 01:59:46.963426 tst handover.py: using BVCI 18282 01:59:47.077103 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 01:59:47.111984 tst handover.py: using LAC 18282 01:59:47.270358 tst handover.py: using RAC 177 01:59:47.398102 tst handover.py: using CellId 18282 01:59:47.517233 tst handover.py: using BVCI 18283 01:59:47.627295 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:47.638115 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:47.648648 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:47.659593 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:47.670475 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:47.681413 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 01:59:47.800500 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 01:59:47.918785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:48.366553 run create_hlr_db(pid=9631): Launched 01:59:48.483052 bus /sierra_2: Setting Powered False 01:59:49.544667 run create_hlr_db(pid=9631): Terminated: ok {rc=0} 01:59:49.963595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9633): Launched 01:59:50.293435 run osmo-hlr_10.42.42.2(pid=9634): Launched 01:59:50.420837 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:50.960740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9636): Launched 01:59:51.289779 run osmo-stp_10.42.42.5(pid=9637): Launched 01:59:51.415828 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:51.982640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9639): Launched 01:59:52.312194 run osmo-msc_10.42.42.6(pid=9640): Launched 01:59:52.495893 run osmo-stp_10.42.42.5(pid=9637): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9637)] 01:59:52.634511 run osmo-stp_10.42.42.5(pid=9637): stdout: | (launched: 2022-12-09_01:59:51.229354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:52.772810 run osmo-stp_10.42.42.5(pid=9637): stderr: | 20221209015951423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015951423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015951423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015951423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015951426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015951426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015951426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:52.909995 run osmo-stp_10.42.42.5(pid=9637): stdout: | (launched: 2022-12-09_01:59:51.229354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:53.040467 run osmo-stp_10.42.42.5(pid=9637): stderr: | 20221209015951423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209015951423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209015951423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209015951423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209015951426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209015951426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209015951426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:53.196519 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9637): Process ended prematurely: osmo-stp_10.42.42.5(pid=9637) [trial-2352↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9637)] [trial-2352↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 01:59:53.205442 tst handover.py:18: Test FAILED (6.7 sec) 01:59:53.232995 run osmo-hlr_10.42.42.2(pid=9634): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9634)] 01:59:53.283156 run osmo-hlr_10.42.42.2(pid=9634): stdout: | (launched: 2022-12-09_01:59:50.233297) 01:59:53.335034 run osmo-hlr_10.42.42.2(pid=9634): stderr: | 20221209015950432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209015950432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209015950432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209015950432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209015950432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209015950432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209015950454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209015950463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209015950463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209015950463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:53.407457 run osmo-msc_10.42.42.6(pid=9640): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9640)] 01:59:53.457530 run osmo-msc_10.42.42.6(pid=9640): stdout: | (launched: 2022-12-09_01:59:52.251657) 01:59:53.509790 run osmo-msc_10.42.42.6(pid=9640): stderr: | 20221209015952575 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209015952575 DLGLOBAL DEBUG validating counter group 0x7fabf0bc7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209015952575 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209015952575 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209015952575 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209015952576 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209015952577 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209015952578 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209015952578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209015952578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:53.562000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9633): Terminating (SIGTERM) 01:59:53.603979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9636): Terminating (SIGTERM) 01:59:53.645999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9639): Terminating (SIGTERM) 01:59:53.688120 --- ParallelTerminationStrategy: PID 9633 died... 01:59:53.707646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9633): Terminated: ok {rc=0} 01:59:53.753919 --- ParallelTerminationStrategy: PID 9636 died... 01:59:53.773387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9636): Terminated: ok {rc=0} 01:59:53.819174 --- ParallelTerminationStrategy: PID 9639 died... 01:59:53.838571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9639): Terminated: ok {rc=0} 01:59:53.926159 bus /sierra_3: Setting Powered False 01:59:55.025109 bus /sierra_3: Setting Powered False 01:59:56.140152 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 01:59:57.384747 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:57.390407 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 01:59:57.441852 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 01:59:57.469156 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 01:59:57.522954 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 01:59:57.574517 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 01:59:57.601640 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 01:59:58.152277 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 01:59:58.157656 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:58.168696 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:59:58.204585 tst handover.py: using LAC 18283 01:59:58.333760 tst handover.py: using RAC 178 01:59:58.464558 tst handover.py: using CellId 18283 01:59:58.595441 tst handover.py: using BVCI 18284 01:59:58.715895 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:59:58.770219 tst handover.py: using LAC 18284 01:59:58.898720 tst handover.py: using RAC 179 01:59:59.024927 tst handover.py: using CellId 18284 01:59:59.154973 tst handover.py: using BVCI 18285 01:59:59.275250 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:59.286489 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:59.297542 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:59.308665 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:59.319803 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:59.330841 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:59:59.445428 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:59:59.561641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:00.009965 run create_hlr_db(pid=9645): Launched 02:00:00.127794 bus /sierra_2: Setting Powered False 02:00:01.205444 run create_hlr_db(pid=9645): Terminated: ok {rc=0} 02:00:01.710349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9650): Launched 02:00:02.054470 run osmo-hlr_10.42.42.2(pid=9651): Launched 02:00:02.275598 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:02.779409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9653): Launched 02:00:03.085496 run osmo-stp_10.42.42.5(pid=9654): Launched 02:00:03.203820 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:03.744427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9656): Launched 02:00:04.051143 run osmo-msc_10.42.42.6(pid=9657): Launched 02:00:04.222459 run osmo-stp_10.42.42.5(pid=9654): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9654)] 02:00:04.352671 run osmo-stp_10.42.42.5(pid=9654): stdout: | (launched: 2022-12-09_02:00:03.029413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:04.481934 run osmo-stp_10.42.42.5(pid=9654): stderr: | 20221209020003199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020003199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020003199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020003200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020003200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020003200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020003200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:04.609455 run osmo-stp_10.42.42.5(pid=9654): stdout: | (launched: 2022-12-09_02:00:03.029413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:04.730863 run osmo-stp_10.42.42.5(pid=9654): stderr: | 20221209020003199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020003199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020003199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020003200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020003200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020003200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020003200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:04.876035 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9654): Process ended prematurely: osmo-stp_10.42.42.5(pid=9654) [trial-2352↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9654)] [trial-2352↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 02:00:04.884243 tst handover.py:18: Test FAILED (6.7 sec) 02:00:04.910499 run osmo-hlr_10.42.42.2(pid=9651): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9651)] 02:00:04.958619 run osmo-hlr_10.42.42.2(pid=9651): stdout: | (launched: 2022-12-09_02:00:01.994351) 02:00:05.008378 run osmo-hlr_10.42.42.2(pid=9651): stderr: | 20221209020002225 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020002225 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020002225 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020002225 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020002225 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020002226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020002241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020002258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020002258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020002258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:05.077427 run osmo-msc_10.42.42.6(pid=9657): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9657)] 02:00:05.125264 run osmo-msc_10.42.42.6(pid=9657): stdout: | (launched: 2022-12-09_02:00:03.994900) 02:00:05.175149 run osmo-msc_10.42.42.6(pid=9657): stderr: | 20221209020004268 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020004268 DLGLOBAL DEBUG validating counter group 0x7fd9ff2d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020004268 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020004268 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020004268 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020004268 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020004270 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020004271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020004271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020004271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:05.225238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9650): Terminating (SIGTERM) 02:00:05.265082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9653): Terminating (SIGTERM) 02:00:05.304657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9656): Terminating (SIGTERM) 02:00:05.345333 --- ParallelTerminationStrategy: PID 9650 died... 02:00:05.364055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9650): Terminated: ok {rc=0} 02:00:05.408529 --- ParallelTerminationStrategy: PID 9653 died... 02:00:05.426997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9653): Terminated: ok {rc=0} 02:00:05.470853 --- ParallelTerminationStrategy: PID 9656 died... 02:00:05.489233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9656): Terminated: ok {rc=0} 02:00:05.575116 bus /sierra_3: Setting Powered False 02:00:06.674362 bus /sierra_3: Setting Powered False 02:00:07.790043 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 02:00:09.047262 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:09.053230 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 02:00:09.100811 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 02:00:09.127980 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 02:00:09.180714 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 02:00:09.227707 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 02:00:09.254920 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 02:00:09.806163 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 02:00:09.811515 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:09.822638 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:00:09.858099 tst handover.py: using LAC 18285 02:00:09.978407 tst handover.py: using RAC 180 02:00:10.098863 tst handover.py: using CellId 18285 02:00:10.220558 tst handover.py: using BVCI 18286 02:00:10.334602 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:00:10.379120 tst handover.py: using LAC 18286 02:00:10.501262 tst handover.py: using RAC 181 02:00:10.624045 tst handover.py: using CellId 18286 02:00:10.744084 tst handover.py: using BVCI 18287 02:00:10.856921 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:10.868061 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:10.878994 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:10.890153 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:10.901498 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:10.912532 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:00:11.034234 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:00:11.154160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:11.634630 run create_hlr_db(pid=9662): Launched 02:00:11.769112 bus /sierra_2: Setting Powered False 02:00:12.834202 run create_hlr_db(pid=9662): Terminated: ok {rc=0} 02:00:13.245720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9664): Launched 02:00:13.551426 run osmo-hlr_10.42.42.2(pid=9665): Launched 02:00:13.670626 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:14.185680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9667): Launched 02:00:14.493756 run osmo-stp_10.42.42.5(pid=9668): Launched 02:00:14.612174 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:15.140428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9670): Launched 02:00:15.446960 run osmo-msc_10.42.42.6(pid=9671): Launched 02:00:15.619532 run osmo-stp_10.42.42.5(pid=9668): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9668)] 02:00:15.750172 run osmo-stp_10.42.42.5(pid=9668): stdout: | (launched: 2022-12-09_02:00:14.437359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:15.888113 run osmo-stp_10.42.42.5(pid=9668): stderr: | 20221209020014608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020014609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020014609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020014609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020014610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020014610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020014610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:16.037392 run osmo-stp_10.42.42.5(pid=9668): stdout: | (launched: 2022-12-09_02:00:14.437359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:16.164466 run osmo-stp_10.42.42.5(pid=9668): stderr: | 20221209020014608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020014609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020014609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020014609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020014610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020014610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020014610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:16.316302 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9668): Process ended prematurely: osmo-stp_10.42.42.5(pid=9668) [trial-2352↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9668)] [trial-2352↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 02:00:16.325828 tst handover.py:18: Test FAILED (6.5 sec) 02:00:16.355939 run osmo-hlr_10.42.42.2(pid=9665): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9665)] 02:00:16.406460 run osmo-hlr_10.42.42.2(pid=9665): stdout: | (launched: 2022-12-09_02:00:13.495126) 02:00:16.458434 run osmo-hlr_10.42.42.2(pid=9665): stderr: | 20221209020013672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020013672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020013672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020013672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020013672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020013672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020013686 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020013694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020013694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020013694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:16.530351 run osmo-msc_10.42.42.6(pid=9671): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9671)] 02:00:16.581237 run osmo-msc_10.42.42.6(pid=9671): stdout: | (launched: 2022-12-09_02:00:15.390557) 02:00:16.633957 run osmo-msc_10.42.42.6(pid=9671): stderr: | 20221209020015664 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020015665 DLGLOBAL DEBUG validating counter group 0x7effabc3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020015665 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020015665 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020015665 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020015665 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020015667 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020015667 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020015668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020015668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:16.686888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9664): Terminating (SIGTERM) 02:00:16.728941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9667): Terminating (SIGTERM) 02:00:16.771542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9670): Terminating (SIGTERM) 02:00:16.813942 --- ParallelTerminationStrategy: PID 9664 died... 02:00:16.833563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9664): Terminated: ok {rc=0} 02:00:16.888378 --- ParallelTerminationStrategy: PID 9667 died... 02:00:16.908129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9667): Terminated: ok {rc=0} 02:00:16.956269 --- ParallelTerminationStrategy: PID 9670 died... 02:00:16.975824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9670): Terminated: ok {rc=0} 02:00:17.068690 bus /sierra_3: Setting Powered False 02:00:18.169113 bus /sierra_3: Setting Powered False 02:00:19.282200 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 02:00:20.532010 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:20.537089 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 02:00:20.588235 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:00:20.614685 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:00:20.667355 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 02:00:20.721115 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:00:20.747811 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:00:21.297979 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 02:00:21.305318 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:21.316783 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:00:21.352267 tst handover.py: using LAC 18287 02:00:21.483044 tst handover.py: using RAC 182 02:00:21.611792 tst handover.py: using CellId 18287 02:00:21.740240 tst handover.py: using BVCI 18288 02:00:21.858967 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:00:21.912520 tst handover.py: using LAC 18288 02:00:22.039797 tst handover.py: using RAC 183 02:00:22.167116 tst handover.py: using CellId 18288 02:00:22.294233 tst handover.py: using BVCI 18289 02:00:22.413783 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:22.425458 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:22.436620 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:22.447946 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:22.459256 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:22.470548 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:00:22.586260 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:00:22.702755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:23.149807 run create_hlr_db(pid=9676): Launched 02:00:23.267627 bus /sierra_2: Setting Powered False 02:00:24.327695 run create_hlr_db(pid=9676): Terminated: ok {rc=0} 02:00:24.748893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9678): Launched 02:00:25.077152 run osmo-hlr_10.42.42.2(pid=9679): Launched 02:00:25.203021 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:25.742868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9681): Launched 02:00:26.070990 run osmo-stp_10.42.42.5(pid=9682): Launched 02:00:26.198221 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:26.763880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9684): Launched 02:00:27.093669 run osmo-msc_10.42.42.6(pid=9685): Launched 02:00:27.279210 run osmo-stp_10.42.42.5(pid=9682): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9682)] 02:00:27.417922 run osmo-stp_10.42.42.5(pid=9682): stdout: | (launched: 2022-12-09_02:00:26.011191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:27.557286 run osmo-stp_10.42.42.5(pid=9682): stderr: | 20221209020026203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020026203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020026203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020026204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020026204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020026204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020026204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:27.695071 run osmo-stp_10.42.42.5(pid=9682): stdout: | (launched: 2022-12-09_02:00:26.011191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:27.826126 run osmo-stp_10.42.42.5(pid=9682): stderr: | 20221209020026203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020026203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020026203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020026204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020026204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020026204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020026204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:27.983051 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9682): Process ended prematurely: osmo-stp_10.42.42.5(pid=9682) [trial-2352↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9682)] [trial-2352↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 02:00:27.991872 tst handover.py:18: Test FAILED (6.7 sec) 02:00:28.019396 run osmo-hlr_10.42.42.2(pid=9679): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9679)] 02:00:28.069528 run osmo-hlr_10.42.42.2(pid=9679): stdout: | (launched: 2022-12-09_02:00:25.016447) 02:00:28.121548 run osmo-hlr_10.42.42.2(pid=9679): stderr: | 20221209020025215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020025215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020025216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020025216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020025216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020025216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020025229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020025238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020025239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020025239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:28.193973 run osmo-msc_10.42.42.6(pid=9685): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9685)] 02:00:28.244101 run osmo-msc_10.42.42.6(pid=9685): stdout: | (launched: 2022-12-09_02:00:27.033827) 02:00:28.295962 run osmo-msc_10.42.42.6(pid=9685): stderr: | 20221209020027358 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020027359 DLGLOBAL DEBUG validating counter group 0x7fe122cdec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020027359 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020027359 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020027359 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020027359 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020027361 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020027361 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020027361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020027361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:28.348565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9678): Terminating (SIGTERM) 02:00:28.390277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9681): Terminating (SIGTERM) 02:00:28.432143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9684): Terminating (SIGTERM) 02:00:28.474433 --- ParallelTerminationStrategy: PID 9678 died... 02:00:28.494360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9678): Terminated: ok {rc=0} 02:00:28.540776 --- ParallelTerminationStrategy: PID 9681 died... 02:00:28.560285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9681): Terminated: ok {rc=0} 02:00:28.606288 --- ParallelTerminationStrategy: PID 9684 died... 02:00:28.625843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9684): Terminated: ok {rc=0} 02:00:28.712802 bus /sierra_3: Setting Powered False 02:00:29.809673 bus /sierra_3: Setting Powered False 02:00:30.938784 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 02:00:32.204036 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:32.209950 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:00:32.252056 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:00:32.281485 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:00:32.332927 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:00:32.373423 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:00:32.400581 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:00:32.947082 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 02:00:32.953277 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:32.964407 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 02:00:33.000012 tst handover.py: using LAC 18289 02:00:33.120288 tst handover.py: using RAC 184 02:00:33.248666 tst handover.py: using CellId 18289 02:00:33.375823 tst handover.py: using BVCI 18290 02:00:33.496575 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 02:00:33.530896 tst handover.py: using LAC 18290 02:00:33.658173 tst handover.py: using RAC 185 02:00:33.785744 tst handover.py: using CellId 18290 02:00:33.914527 tst handover.py: using BVCI 18291 02:00:34.033643 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:34.044793 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:34.055965 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:34.067535 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:34.079120 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:34.090727 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 02:00:34.208146 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 02:00:34.323214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:34.770355 run create_hlr_db(pid=9690): Launched 02:00:34.889359 bus /sierra_2: Setting Powered False 02:00:35.949971 run create_hlr_db(pid=9690): Terminated: ok {rc=0} 02:00:36.370207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9692): Launched 02:00:36.699658 run osmo-hlr_10.42.42.2(pid=9693): Launched 02:00:36.825336 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:37.361209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9695): Launched 02:00:37.690877 run osmo-stp_10.42.42.5(pid=9696): Launched 02:00:37.816081 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:38.380488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9698): Launched 02:00:38.710243 run osmo-msc_10.42.42.6(pid=9699): Launched 02:00:38.894990 run osmo-stp_10.42.42.5(pid=9696): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9696)] 02:00:39.032287 run osmo-stp_10.42.42.5(pid=9696): stdout: | (launched: 2022-12-09_02:00:37.630586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:39.170465 run osmo-stp_10.42.42.5(pid=9696): stderr: | 20221209020037823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020037823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020037823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020037824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020037824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020037824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020037825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:39.307524 run osmo-stp_10.42.42.5(pid=9696): stdout: | (launched: 2022-12-09_02:00:37.630586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:39.438380 run osmo-stp_10.42.42.5(pid=9696): stderr: | 20221209020037823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020037823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020037823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020037824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020037824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020037824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020037825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:39.595033 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9696): Process ended prematurely: osmo-stp_10.42.42.5(pid=9696) [trial-2352↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9696)] [trial-2352↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 02:00:39.604087 tst handover.py:18: Test FAILED (6.6 sec) 02:00:39.632135 run osmo-hlr_10.42.42.2(pid=9693): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9693)] 02:00:39.682600 run osmo-hlr_10.42.42.2(pid=9693): stdout: | (launched: 2022-12-09_02:00:36.639468) 02:00:39.734903 run osmo-hlr_10.42.42.2(pid=9693): stderr: | 20221209020036840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020036840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020036840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020036840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020036840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020036840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020036854 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020036862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020036862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020036862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:39.807522 run osmo-msc_10.42.42.6(pid=9699): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9699)] 02:00:39.857754 run osmo-msc_10.42.42.6(pid=9699): stdout: | (launched: 2022-12-09_02:00:38.650311) 02:00:39.909574 run osmo-msc_10.42.42.6(pid=9699): stderr: | 20221209020038972 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020038972 DLGLOBAL DEBUG validating counter group 0x7f8c03146c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020038973 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020038973 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020038973 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020038973 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020038975 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020038975 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020038975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020038975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:39.962067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9692): Terminating (SIGTERM) 02:00:40.003997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9695): Terminating (SIGTERM) 02:00:40.046153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9698): Terminating (SIGTERM) 02:00:40.088391 --- ParallelTerminationStrategy: PID 9692 died... 02:00:40.108495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9692): Terminated: ok {rc=0} 02:00:40.155462 --- ParallelTerminationStrategy: PID 9695 died... 02:00:40.175192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9695): Terminated: ok {rc=0} 02:00:40.221830 --- ParallelTerminationStrategy: PID 9698 died... 02:00:40.241627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9698): Terminated: ok {rc=0} 02:00:40.328895 bus /sierra_3: Setting Powered False 02:00:41.430127 bus /sierra_3: Setting Powered False 02:00:42.547680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 02:00:43.787283 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:43.792740 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:00:43.844175 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:00:43.871229 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:00:43.923124 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:00:43.973308 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:00:44.000110 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:00:44.551355 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 02:00:44.556856 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:44.568286 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:00:44.612103 tst handover.py: using LAC 18291 02:00:44.734948 tst handover.py: using RAC 186 02:00:44.859180 tst handover.py: using CellId 18291 02:00:44.981633 tst handover.py: using BVCI 18292 02:00:45.102236 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:00:45.151860 tst handover.py: using LAC 18292 02:00:45.280618 tst handover.py: using RAC 187 02:00:45.406850 tst handover.py: using CellId 18292 02:00:45.535404 tst handover.py: using BVCI 18293 02:00:45.654590 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:45.666167 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:45.677526 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:45.689048 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:45.700748 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:45.712218 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:00:45.827003 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:00:45.965981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:46.507070 run create_hlr_db(pid=9705): Launched 02:00:46.674215 bus /sierra_2: Setting Powered False 02:00:47.739594 run create_hlr_db(pid=9705): Terminated: ok {rc=0} 02:00:48.150458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9707): Launched 02:00:48.457843 run osmo-hlr_10.42.42.2(pid=9708): Launched 02:00:48.575943 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:49.089470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9710): Launched 02:00:49.395804 run osmo-stp_10.42.42.5(pid=9711): Launched 02:00:49.512850 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:50.041374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9713): Launched 02:00:50.349275 run osmo-msc_10.42.42.6(pid=9714): Launched 02:00:50.521470 run osmo-stp_10.42.42.5(pid=9711): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9711)] 02:00:50.651823 run osmo-stp_10.42.42.5(pid=9711): stdout: | (launched: 2022-12-09_02:00:49.339719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:50.780908 run osmo-stp_10.42.42.5(pid=9711): stderr: | 20221209020049512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020049512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020049512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020049513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020049513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020049514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020049514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:50.908049 run osmo-stp_10.42.42.5(pid=9711): stdout: | (launched: 2022-12-09_02:00:49.339719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:51.029340 run osmo-stp_10.42.42.5(pid=9711): stderr: | 20221209020049512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020049512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020049512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020049513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020049513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020049514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020049514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:51.174325 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9711): Process ended prematurely: osmo-stp_10.42.42.5(pid=9711) [trial-2352↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9711)] [trial-2352↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 02:00:51.182545 tst handover.py:18: Test FAILED (6.6 sec) 02:00:51.209275 run osmo-hlr_10.42.42.2(pid=9708): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9708)] 02:00:51.257516 run osmo-hlr_10.42.42.2(pid=9708): stdout: | (launched: 2022-12-09_02:00:48.401252) 02:00:51.307402 run osmo-hlr_10.42.42.2(pid=9708): stderr: | 20221209020048579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020048579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020048579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020048579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020048579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020048579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020048590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020048598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020048598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020048599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:51.376794 run osmo-msc_10.42.42.6(pid=9714): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9714)] 02:00:51.424937 run osmo-msc_10.42.42.6(pid=9714): stdout: | (launched: 2022-12-09_02:00:50.292497) 02:00:51.474630 run osmo-msc_10.42.42.6(pid=9714): stderr: | 20221209020050564 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020050564 DLGLOBAL DEBUG validating counter group 0x7f9da0934c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020050565 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020050565 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020050565 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020050565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020050567 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020050567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020050567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020050567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:51.524804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9707): Terminating (SIGTERM) 02:00:51.564862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9710): Terminating (SIGTERM) 02:00:51.604915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9713): Terminating (SIGTERM) 02:00:51.645158 --- ParallelTerminationStrategy: PID 9707 died... 02:00:51.664150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9707): Terminated: ok {rc=0} 02:00:51.709169 --- ParallelTerminationStrategy: PID 9710 died... 02:00:51.727660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9710): Terminated: ok {rc=0} 02:00:51.771754 --- ParallelTerminationStrategy: PID 9713 died... 02:00:51.790427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9713): Terminated: ok {rc=0} 02:00:51.876228 bus /sierra_3: Setting Powered False 02:00:52.976202 bus /sierra_3: Setting Powered False 02:00:54.092933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 02:00:55.344717 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:55.350061 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:00:55.399614 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:00:55.425796 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:00:55.478412 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:00:55.528634 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:00:55.554786 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:00:56.102653 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 02:00:56.107873 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:56.118636 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:00:56.155749 tst handover.py: using LAC 18293 02:00:56.275867 tst handover.py: using RAC 188 02:00:56.394470 tst handover.py: using CellId 18293 02:00:56.514534 tst handover.py: using BVCI 18294 02:00:56.627729 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:00:56.672859 tst handover.py: using LAC 18294 02:00:56.790599 tst handover.py: using RAC 189 02:00:56.908410 tst handover.py: using CellId 18294 02:00:57.026965 tst handover.py: using BVCI 18295 02:00:57.139836 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:57.150725 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:57.161444 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:57.172238 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:57.183107 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:57.193982 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:00:57.312721 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:00:57.431404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:57.911450 run create_hlr_db(pid=9719): Launched 02:00:58.046299 bus /sierra_2: Setting Powered False 02:00:59.111204 run create_hlr_db(pid=9719): Terminated: ok {rc=0} 02:00:59.541056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9721): Launched 02:00:59.871365 run osmo-hlr_10.42.42.2(pid=9722): Launched 02:00:59.997104 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:00.536194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9724): Launched 02:01:00.869758 run osmo-stp_10.42.42.5(pid=9725): Launched 02:01:01.067937 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:01.800018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9727): Launched 02:01:02.241298 run osmo-msc_10.42.42.6(pid=9728): Launched 02:01:02.441081 run osmo-stp_10.42.42.5(pid=9725): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9725)] 02:01:02.573557 run osmo-stp_10.42.42.5(pid=9725): stdout: | (launched: 2022-12-09_02:01:00.807197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:02.708602 run osmo-stp_10.42.42.5(pid=9725): stderr: | 20221209020101167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020101168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020101168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020101170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020101170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020101170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020101171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:02.837496 run osmo-stp_10.42.42.5(pid=9725): stdout: | (launched: 2022-12-09_02:01:00.807197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:02.969760 run osmo-stp_10.42.42.5(pid=9725): stderr: | 20221209020101167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020101168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020101168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020101170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020101170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020101170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020101171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:03.127748 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9725): Process ended prematurely: osmo-stp_10.42.42.5(pid=9725) [trial-2352↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9725)] [trial-2352↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 02:01:03.136836 tst handover.py:18: Test FAILED (7.0 sec) 02:01:03.164907 run osmo-hlr_10.42.42.2(pid=9722): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9722)] 02:01:03.215785 run osmo-hlr_10.42.42.2(pid=9722): stdout: | (launched: 2022-12-09_02:00:59.811109) 02:01:03.268220 run osmo-hlr_10.42.42.2(pid=9722): stderr: | 20221209020100011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020100011 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020100011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020100011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020100011 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020100011 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020100024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020100032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020100032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020100033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:03.341127 run osmo-msc_10.42.42.6(pid=9728): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9728)] 02:01:03.391817 run osmo-msc_10.42.42.6(pid=9728): stdout: | (launched: 2022-12-09_02:01:02.161338) 02:01:03.444246 run osmo-msc_10.42.42.6(pid=9728): stderr: | 20221209020102546 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020102546 DLGLOBAL DEBUG validating counter group 0x7f8096bb2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020102546 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020102546 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020102546 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020102546 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020102548 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020102549 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020102549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020102549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:03.497057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9721): Terminating (SIGTERM) 02:01:03.539960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9724): Terminating (SIGTERM) 02:01:03.582711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9727): Terminating (SIGTERM) 02:01:03.625603 --- ParallelTerminationStrategy: PID 9721 died... 02:01:03.645778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9721): Terminated: ok {rc=0} 02:01:03.692475 --- ParallelTerminationStrategy: PID 9724 died... 02:01:03.712082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9724): Terminated: ok {rc=0} 02:01:03.759097 --- ParallelTerminationStrategy: PID 9727 died... 02:01:03.778915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9727): Terminated: ok {rc=0} 02:01:03.867327 bus /sierra_3: Setting Powered False 02:01:04.966907 bus /sierra_3: Setting Powered False 02:01:06.084797 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 02:01:07.335237 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:07.340477 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 02:01:07.389303 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 02:01:07.415665 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 02:01:07.467196 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 02:01:07.516344 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 02:01:07.543140 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 02:01:08.091124 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 02:01:08.096448 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:01:08.107412 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 02:01:08.141458 tst handover.py: using LAC 18295 02:01:08.272237 tst handover.py: using RAC 190 02:01:08.400384 tst handover.py: using CellId 18295 02:01:08.528830 tst handover.py: using BVCI 18296 02:01:08.648722 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 02:01:08.700064 tst handover.py: using LAC 18296 02:01:08.829079 tst handover.py: using RAC 191 02:01:08.958488 tst handover.py: using CellId 18296 02:01:09.092541 tst handover.py: using BVCI 18297 02:01:09.212839 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:01:09.224380 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:01:09.235643 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:01:09.247131 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:01:09.258731 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:01:09.270229 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 02:01:09.387211 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 02:01:09.506103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:09.984215 run create_hlr_db(pid=9733): Launched 02:01:10.118308 bus /sierra_2: Setting Powered False 02:01:11.182918 run create_hlr_db(pid=9733): Terminated: ok {rc=0} 02:01:11.611717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9735): Launched 02:01:11.941380 run osmo-hlr_10.42.42.2(pid=9736): Launched 02:01:12.067266 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:12.603240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9738): Launched 02:01:12.932348 run osmo-stp_10.42.42.5(pid=9739): Launched 02:01:13.057705 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:13.624371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9741): Launched 02:01:13.953366 run osmo-msc_10.42.42.6(pid=9742): Launched 02:01:14.136450 run osmo-stp_10.42.42.5(pid=9739): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9739)] 02:01:14.274356 run osmo-stp_10.42.42.5(pid=9739): stdout: | (launched: 2022-12-09_02:01:12.872590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:14.413158 run osmo-stp_10.42.42.5(pid=9739): stderr: | 20221209020113068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020113068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020113069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020113069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020113069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020113069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020113070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:14.551245 run osmo-stp_10.42.42.5(pid=9739): stdout: | (launched: 2022-12-09_02:01:12.872590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:14.682773 run osmo-stp_10.42.42.5(pid=9739): stderr: | 20221209020113068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020113068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020113069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020113069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020113069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020113069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020113070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:14.840265 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9739): Process ended prematurely: osmo-stp_10.42.42.5(pid=9739) [trial-2352↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9739)] [trial-2352↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 02:01:14.849489 tst handover.py:18: Test FAILED (6.7 sec) 02:01:14.877319 run osmo-hlr_10.42.42.2(pid=9736): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9736)] 02:01:14.928003 run osmo-hlr_10.42.42.2(pid=9736): stdout: | (launched: 2022-12-09_02:01:11.881268) 02:01:14.980186 run osmo-hlr_10.42.42.2(pid=9736): stderr: | 20221209020112083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020112083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020112083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020112083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020112083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020112083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020112095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020112104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020112104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020112104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:15.052868 run osmo-msc_10.42.42.6(pid=9742): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9742)] 02:01:15.103551 run osmo-msc_10.42.42.6(pid=9742): stdout: | (launched: 2022-12-09_02:01:13.893088) 02:01:15.155217 run osmo-msc_10.42.42.6(pid=9742): stderr: | 20221209020114216 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020114216 DLGLOBAL DEBUG validating counter group 0x7f62fa7b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020114216 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020114216 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020114217 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020114217 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020114219 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020114219 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020114219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020114219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:15.207317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9735): Terminating (SIGTERM) 02:01:15.249490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9738): Terminating (SIGTERM) 02:01:15.291733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9741): Terminating (SIGTERM) 02:01:15.334357 --- ParallelTerminationStrategy: PID 9735 died... 02:01:15.354574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9735): Terminated: ok {rc=0} 02:01:15.401496 --- ParallelTerminationStrategy: PID 9738 died... 02:01:15.421092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9738): Terminated: ok {rc=0} 02:01:15.467669 --- ParallelTerminationStrategy: PID 9741 died... 02:01:15.487322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9741): Terminated: ok {rc=0} 02:01:15.575685 bus /sierra_3: Setting Powered False 02:01:16.674440 bus /sierra_3: Setting Powered False 02:01:17.788030 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 02:01:19.043544 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:19.049355 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 02:01:19.095235 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 02:01:19.122579 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 02:01:19.173580 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 02:01:19.219127 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 02:01:19.246140 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 02:01:19.801733 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 02:01:19.808479 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:19.820256 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:01:19.856172 tst handover.py: using LAC 18297 02:01:19.976442 tst handover.py: using RAC 192 02:01:20.095708 tst handover.py: using CellId 18297 02:01:20.224004 tst handover.py: using BVCI 18298 02:01:20.344864 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:01:20.393335 tst handover.py: using LAC 18298 02:01:20.522022 tst handover.py: using RAC 193 02:01:20.649328 tst handover.py: using CellId 18298 02:01:20.776864 tst handover.py: using BVCI 18299 02:01:20.889844 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:20.900855 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:20.911718 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:20.923094 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:20.934187 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:20.945407 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:01:21.064165 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:01:21.183102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:21.666099 run create_hlr_db(pid=9747): Launched 02:01:21.799449 bus /sierra_2: Setting Powered False 02:01:22.863837 run create_hlr_db(pid=9747): Terminated: ok {rc=0} 02:01:23.276505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9749): Launched 02:01:23.584520 run osmo-hlr_10.42.42.2(pid=9750): Launched 02:01:23.704211 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:24.219394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9752): Launched 02:01:24.525165 run osmo-stp_10.42.42.5(pid=9753): Launched 02:01:24.643284 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:25.172554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9755): Launched 02:01:25.479125 run osmo-msc_10.42.42.6(pid=9756): Launched 02:01:25.651441 run osmo-stp_10.42.42.5(pid=9753): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9753)] 02:01:25.783457 run osmo-stp_10.42.42.5(pid=9753): stdout: | (launched: 2022-12-09_02:01:24.468905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:25.913196 run osmo-stp_10.42.42.5(pid=9753): stderr: | 20221209020124640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020124640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020124641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020124641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020124642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020124642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020124642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:26.040894 run osmo-stp_10.42.42.5(pid=9753): stdout: | (launched: 2022-12-09_02:01:24.468905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:26.163032 run osmo-stp_10.42.42.5(pid=9753): stderr: | 20221209020124640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020124640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020124641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020124641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020124642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020124642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020124642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:26.308376 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9753): Process ended prematurely: osmo-stp_10.42.42.5(pid=9753) [trial-2352↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9753)] [trial-2352↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 02:01:26.317026 tst handover.py:18: Test FAILED (6.5 sec) 02:01:26.343758 run osmo-hlr_10.42.42.2(pid=9750): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9750)] 02:01:26.392321 run osmo-hlr_10.42.42.2(pid=9750): stdout: | (launched: 2022-12-09_02:01:23.527229) 02:01:26.442586 run osmo-hlr_10.42.42.2(pid=9750): stderr: | 20221209020123707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020123707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020123707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020123707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020123707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020123707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020123719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020123728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020123728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020123728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:26.512252 run osmo-msc_10.42.42.6(pid=9756): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9756)] 02:01:26.561252 run osmo-msc_10.42.42.6(pid=9756): stdout: | (launched: 2022-12-09_02:01:25.422745) 02:01:26.611555 run osmo-msc_10.42.42.6(pid=9756): stderr: | 20221209020125697 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020125697 DLGLOBAL DEBUG validating counter group 0x7f35b487ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020125697 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020125697 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020125698 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020125698 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020125699 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020125700 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020125700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020125700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:26.661811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9749): Terminating (SIGTERM) 02:01:26.702202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9752): Terminating (SIGTERM) 02:01:26.742230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9755): Terminating (SIGTERM) 02:01:26.782423 --- ParallelTerminationStrategy: PID 9749 died... 02:01:26.801564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9749): Terminated: ok {rc=0} 02:01:26.846544 --- ParallelTerminationStrategy: PID 9752 died... 02:01:26.865331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9752): Terminated: ok {rc=0} 02:01:26.909857 --- ParallelTerminationStrategy: PID 9755 died... 02:01:26.928616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9755): Terminated: ok {rc=0} 02:01:27.013583 bus /sierra_3: Setting Powered False 02:01:28.112184 bus /sierra_3: Setting Powered False 02:01:29.229163 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 02:01:30.487331 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:30.493189 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 02:01:30.544091 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:01:30.571946 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:01:30.626616 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 02:01:30.677896 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:01:30.705439 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:01:31.256873 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 02:01:31.264930 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:31.277570 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:01:31.313039 tst handover.py: using LAC 18299 02:01:31.442957 tst handover.py: using RAC 194 02:01:31.612562 tst handover.py: using CellId 18299 02:01:31.738854 tst handover.py: using BVCI 18300 02:01:31.860077 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:01:31.911225 tst handover.py: using LAC 18300 02:01:32.065805 tst handover.py: using RAC 195 02:01:32.194762 tst handover.py: using CellId 18300 02:01:32.318468 tst handover.py: using BVCI 18301 02:01:32.432727 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:32.443939 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:32.454909 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:32.466615 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:32.478462 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:32.489928 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:01:32.608364 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:01:32.725227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:33.173199 run create_hlr_db(pid=9761): Launched 02:01:33.290831 bus /sierra_2: Setting Powered False 02:01:34.351531 run create_hlr_db(pid=9761): Terminated: ok {rc=0} 02:01:34.770689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9763): Launched 02:01:35.102592 run osmo-hlr_10.42.42.2(pid=9764): Launched 02:01:35.227912 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:35.766884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9766): Launched 02:01:36.096311 run osmo-stp_10.42.42.5(pid=9767): Launched 02:01:36.222251 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:36.786634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9769): Launched 02:01:37.117326 run osmo-msc_10.42.42.6(pid=9770): Launched 02:01:37.300177 run osmo-stp_10.42.42.5(pid=9767): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9767)] 02:01:37.438616 run osmo-stp_10.42.42.5(pid=9767): stdout: | (launched: 2022-12-09_02:01:36.036116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:37.578249 run osmo-stp_10.42.42.5(pid=9767): stderr: | 20221209020136229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020136229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020136230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020136230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020136230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020136231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020136231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:37.715817 run osmo-stp_10.42.42.5(pid=9767): stdout: | (launched: 2022-12-09_02:01:36.036116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:37.846461 run osmo-stp_10.42.42.5(pid=9767): stderr: | 20221209020136229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020136229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020136230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020136230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020136230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020136231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020136231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:38.002604 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9767): Process ended prematurely: osmo-stp_10.42.42.5(pid=9767) [trial-2352↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9767)] [trial-2352↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 02:01:38.011645 tst handover.py:18: Test FAILED (6.7 sec) 02:01:38.039713 run osmo-hlr_10.42.42.2(pid=9764): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9764)] 02:01:38.090277 run osmo-hlr_10.42.42.2(pid=9764): stdout: | (launched: 2022-12-09_02:01:35.042210) 02:01:38.142198 run osmo-hlr_10.42.42.2(pid=9764): stderr: | 20221209020135242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020135242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020135242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020135242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020135242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020135242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020135256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020135266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020135267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020135267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:38.214436 run osmo-msc_10.42.42.6(pid=9770): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9770)] 02:01:38.264424 run osmo-msc_10.42.42.6(pid=9770): stdout: | (launched: 2022-12-09_02:01:37.057068) 02:01:38.315979 run osmo-msc_10.42.42.6(pid=9770): stderr: | 20221209020137382 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020137382 DLGLOBAL DEBUG validating counter group 0x7ff76e317c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020137382 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020137382 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020137383 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020137383 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020137384 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020137385 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020137385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020137385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:38.368080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9763): Terminating (SIGTERM) 02:01:38.409747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9766): Terminating (SIGTERM) 02:01:38.451868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9769): Terminating (SIGTERM) 02:01:38.494613 --- ParallelTerminationStrategy: PID 9763 died... 02:01:38.514618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9763): Terminated: ok {rc=0} 02:01:38.562203 --- ParallelTerminationStrategy: PID 9766 died... 02:01:38.582180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9766): Terminated: ok {rc=0} 02:01:38.629381 --- ParallelTerminationStrategy: PID 9769 died... 02:01:38.649503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9769): Terminated: ok {rc=0} 02:01:38.737916 bus /sierra_3: Setting Powered False 02:01:39.839322 bus /sierra_3: Setting Powered False 02:01:40.955651 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 02:01:42.215325 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:42.220414 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:01:42.257237 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:01:42.283588 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:01:42.335982 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:01:42.372587 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:01:42.398645 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:01:42.946839 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 02:01:42.951922 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:42.962659 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 02:01:42.996543 tst handover.py: using LAC 18301 02:01:43.117685 tst handover.py: using RAC 196 02:01:43.248124 tst handover.py: using CellId 18301 02:01:43.376457 tst handover.py: using BVCI 18302 02:01:43.495295 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 02:01:43.531733 tst handover.py: using LAC 18302 02:01:43.665742 tst handover.py: using RAC 197 02:01:43.793259 tst handover.py: using CellId 18302 02:01:43.919911 tst handover.py: using BVCI 18303 02:01:44.039228 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:44.050543 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:44.061682 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:44.072654 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:44.083751 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:44.094905 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 02:01:44.209689 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 02:01:44.327321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:44.809376 run create_hlr_db(pid=9775): Launched 02:01:44.942552 bus /sierra_2: Setting Powered False 02:01:46.007310 run create_hlr_db(pid=9775): Terminated: ok {rc=0} 02:01:46.455767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9777): Launched 02:01:46.869700 run osmo-hlr_10.42.42.2(pid=9778): Launched 02:01:47.057222 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:47.687056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9780): Launched 02:01:48.016237 run osmo-stp_10.42.42.5(pid=9781): Launched 02:01:48.141170 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:48.707045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9783): Launched 02:01:49.037575 run osmo-msc_10.42.42.6(pid=9784): Launched 02:01:49.223230 run osmo-stp_10.42.42.5(pid=9781): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9781)] 02:01:49.361823 run osmo-stp_10.42.42.5(pid=9781): stdout: | (launched: 2022-12-09_02:01:47.956226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:49.500636 run osmo-stp_10.42.42.5(pid=9781): stderr: | 20221209020148149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020148149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020148149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020148150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020148150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020148150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020148150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:49.638953 run osmo-stp_10.42.42.5(pid=9781): stdout: | (launched: 2022-12-09_02:01:47.956226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:49.769936 run osmo-stp_10.42.42.5(pid=9781): stderr: | 20221209020148149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020148149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020148149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020148150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020148150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020148150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020148150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:49.926485 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9781): Process ended prematurely: osmo-stp_10.42.42.5(pid=9781) [trial-2352↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9781)] [trial-2352↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 02:01:49.935360 tst handover.py:18: Test FAILED (7.0 sec) 02:01:49.963168 run osmo-hlr_10.42.42.2(pid=9778): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9778)] 02:01:50.013439 run osmo-hlr_10.42.42.2(pid=9778): stdout: | (launched: 2022-12-09_02:01:46.803853) 02:01:50.065477 run osmo-hlr_10.42.42.2(pid=9778): stderr: | 20221209020147219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020147219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020147220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020147220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020147220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020147220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020147240 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020147252 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020147252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020147252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:50.138004 run osmo-msc_10.42.42.6(pid=9784): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9784)] 02:01:50.188135 run osmo-msc_10.42.42.6(pid=9784): stdout: | (launched: 2022-12-09_02:01:48.977478) 02:01:50.240136 run osmo-msc_10.42.42.6(pid=9784): stderr: | 20221209020149304 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020149304 DLGLOBAL DEBUG validating counter group 0x7fd5fc6dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020149305 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020149305 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020149305 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020149305 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020149307 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020149307 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020149307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020149307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:50.292327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9777): Terminating (SIGTERM) 02:01:50.334474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9780): Terminating (SIGTERM) 02:01:50.376411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9783): Terminating (SIGTERM) 02:01:50.418791 --- ParallelTerminationStrategy: PID 9777 died... 02:01:50.439108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9777): Terminated: ok {rc=0} 02:01:50.485523 --- ParallelTerminationStrategy: PID 9780 died... 02:01:50.505203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9780): Terminated: ok {rc=0} 02:01:50.551573 --- ParallelTerminationStrategy: PID 9783 died... 02:01:50.571562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9783): Terminated: ok {rc=0} 02:01:50.659988 bus /sierra_3: Setting Powered False 02:01:51.758219 bus /sierra_3: Setting Powered False 02:01:52.875153 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 02:01:54.118174 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:54.124376 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:01:54.173157 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:01:54.199508 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:01:54.250625 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:01:54.301321 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:01:54.329176 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:01:54.884809 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 02:01:54.891278 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:54.902901 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:01:54.938675 tst handover.py: using LAC 18303 02:01:55.067248 tst handover.py: using RAC 198 02:01:55.194998 tst handover.py: using CellId 18303 02:01:55.323780 tst handover.py: using BVCI 18304 02:01:55.444129 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:01:55.492169 tst handover.py: using LAC 18304 02:01:55.619316 tst handover.py: using RAC 199 02:01:55.746624 tst handover.py: using CellId 18304 02:01:55.875547 tst handover.py: using BVCI 18305 02:01:55.994407 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:56.005730 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:56.016801 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:56.027920 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:56.039143 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:56.050238 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:01:56.170681 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:01:56.286056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:56.734695 run create_hlr_db(pid=9789): Launched 02:01:56.854335 bus /sierra_2: Setting Powered False 02:01:57.915424 run create_hlr_db(pid=9789): Terminated: ok {rc=0} 02:01:58.316165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9791): Launched 02:01:58.621876 run osmo-hlr_10.42.42.2(pid=9792): Launched 02:01:58.738954 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:59.256774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9794): Launched 02:01:59.562661 run osmo-stp_10.42.42.5(pid=9795): Launched 02:01:59.681936 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:00.207388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9797): Launched 02:02:00.515052 run osmo-msc_10.42.42.6(pid=9798): Launched 02:02:00.687350 run osmo-stp_10.42.42.5(pid=9795): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9795)] 02:02:00.817083 run osmo-stp_10.42.42.5(pid=9795): stdout: | (launched: 2022-12-09_02:01:59.506460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:01.018438 run osmo-stp_10.42.42.5(pid=9795): stderr: | 20221209020159678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020159678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020159679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020159679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020159679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020159680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020159680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:01.152905 run osmo-stp_10.42.42.5(pid=9795): stdout: | (launched: 2022-12-09_02:01:59.506460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:01.277618 run osmo-stp_10.42.42.5(pid=9795): stderr: | 20221209020159678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020159678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020159679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020159679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020159679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020159680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020159680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:01.448670 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9795): Process ended prematurely: osmo-stp_10.42.42.5(pid=9795) [trial-2352↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9795)] [trial-2352↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 02:02:01.458109 tst handover.py:18: Test FAILED (6.6 sec) 02:02:01.487551 run osmo-hlr_10.42.42.2(pid=9792): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9792)] 02:02:01.537888 run osmo-hlr_10.42.42.2(pid=9792): stdout: | (launched: 2022-12-09_02:01:58.565650) 02:02:01.590083 run osmo-hlr_10.42.42.2(pid=9792): stderr: | 20221209020158742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020158742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020158742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020158742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020158742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020158742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020158755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020158763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020158763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020158763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:01.662305 run osmo-msc_10.42.42.6(pid=9798): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9798)] 02:02:01.712508 run osmo-msc_10.42.42.6(pid=9798): stdout: | (launched: 2022-12-09_02:02:00.458816) 02:02:01.764340 run osmo-msc_10.42.42.6(pid=9798): stderr: | 20221209020200730 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020200731 DLGLOBAL DEBUG validating counter group 0x7f4b5c331c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020200731 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020200731 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020200731 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020200731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020200733 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020200733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020200733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020200734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:01.816770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9791): Terminating (SIGTERM) 02:02:01.859370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9794): Terminating (SIGTERM) 02:02:01.902529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9797): Terminating (SIGTERM) 02:02:01.945422 --- ParallelTerminationStrategy: PID 9791 died... 02:02:01.965567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9791): Terminated: ok {rc=0} 02:02:02.014625 --- ParallelTerminationStrategy: PID 9794 died... 02:02:02.034139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9794): Terminated: ok {rc=0} 02:02:02.081871 --- ParallelTerminationStrategy: PID 9797 died... 02:02:02.101682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9797): Terminated: ok {rc=0} 02:02:02.189537 bus /sierra_3: Setting Powered False 02:02:03.291077 bus /sierra_3: Setting Powered False 02:02:04.409849 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 02:02:05.668242 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:05.673932 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:02:05.723511 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:02:05.750895 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:02:05.803380 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:02:05.852580 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:02:05.879690 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:02:06.430917 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 02:02:06.436270 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:06.447550 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:02:06.482354 tst handover.py: using LAC 18305 02:02:06.604893 tst handover.py: using RAC 200 02:02:06.727787 tst handover.py: using CellId 18305 02:02:06.853801 tst handover.py: using BVCI 18306 02:02:06.975006 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:02:07.027365 tst handover.py: using LAC 18306 02:02:07.160017 tst handover.py: using RAC 201 02:02:07.288940 tst handover.py: using CellId 18306 02:02:07.415634 tst handover.py: using BVCI 18307 02:02:07.536883 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:07.548282 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:07.559373 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:07.570903 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:07.582218 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:07.593423 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:02:07.713807 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:02:07.832656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:08.281324 run create_hlr_db(pid=9804): Launched 02:02:08.398871 bus /sierra_2: Setting Powered False 02:02:09.459208 run create_hlr_db(pid=9804): Terminated: ok {rc=0} 02:02:09.861108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9806): Launched 02:02:10.169143 run osmo-hlr_10.42.42.2(pid=9807): Launched 02:02:10.286790 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:10.807436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9809): Launched 02:02:11.115355 run osmo-stp_10.42.42.5(pid=9810): Launched 02:02:11.233692 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:11.764801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9812): Launched 02:02:12.072764 run osmo-msc_10.42.42.6(pid=9813): Launched 02:02:12.245993 run osmo-stp_10.42.42.5(pid=9810): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9810)] 02:02:12.377736 run osmo-stp_10.42.42.5(pid=9810): stdout: | (launched: 2022-12-09_02:02:11.058525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:12.507646 run osmo-stp_10.42.42.5(pid=9810): stderr: | 20221209020211229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020211229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020211230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020211230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020211230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020211231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020211231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:12.635674 run osmo-stp_10.42.42.5(pid=9810): stdout: | (launched: 2022-12-09_02:02:11.058525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:12.757333 run osmo-stp_10.42.42.5(pid=9810): stderr: | 20221209020211229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020211229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020211230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020211230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020211230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020211231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020211231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:12.903633 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9810): Process ended prematurely: osmo-stp_10.42.42.5(pid=9810) [trial-2352↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9810)] [trial-2352↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 02:02:12.911888 tst handover.py:18: Test FAILED (6.5 sec) 02:02:12.938622 run osmo-hlr_10.42.42.2(pid=9807): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9807)] 02:02:12.986731 run osmo-hlr_10.42.42.2(pid=9807): stdout: | (launched: 2022-12-09_02:02:10.111791) 02:02:13.036574 run osmo-hlr_10.42.42.2(pid=9807): stderr: | 20221209020210292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020210292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020210292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020210292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020210292 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020210292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020210305 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020210314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020210314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020210314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:13.106229 run osmo-msc_10.42.42.6(pid=9813): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9813)] 02:02:13.154286 run osmo-msc_10.42.42.6(pid=9813): stdout: | (launched: 2022-12-09_02:02:12.016050) 02:02:13.204029 run osmo-msc_10.42.42.6(pid=9813): stderr: | 20221209020212288 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020212289 DLGLOBAL DEBUG validating counter group 0x7f218b91bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020212289 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020212289 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020212289 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020212289 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020212291 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020212291 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020212291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020212291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:13.254074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9806): Terminating (SIGTERM) 02:02:13.294730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9809): Terminating (SIGTERM) 02:02:13.334876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9812): Terminating (SIGTERM) 02:02:13.375390 --- ParallelTerminationStrategy: PID 9806 died... 02:02:13.394587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9806): Terminated: ok {rc=0} 02:02:13.439373 --- ParallelTerminationStrategy: PID 9809 died... 02:02:13.457989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9809): Terminated: ok {rc=0} 02:02:13.502500 --- ParallelTerminationStrategy: PID 9812 died... 02:02:13.521143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9812): Terminated: ok {rc=0} 02:02:13.607437 bus /sierra_3: Setting Powered False 02:02:14.707571 bus /sierra_3: Setting Powered False 02:02:15.824649 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 02:02:17.086702 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:17.097625 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 02:02:17.173965 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 02:02:17.203656 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 02:02:17.256301 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 02:02:17.318455 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 02:02:17.346241 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 02:02:17.902000 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 02:02:17.909126 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:02:17.920471 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:02:17.967841 tst handover.py: using LAC 18307 02:02:18.089455 tst handover.py: using RAC 202 02:02:18.209948 tst handover.py: using CellId 18307 02:02:18.329055 tst handover.py: using BVCI 18308 02:02:18.440123 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:02:18.482415 tst handover.py: using LAC 18308 02:02:18.600202 tst handover.py: using RAC 203 02:02:18.718544 tst handover.py: using CellId 18308 02:02:18.838474 tst handover.py: using BVCI 18309 02:02:18.951324 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:02:18.962385 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:02:18.973245 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:02:18.984354 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:02:18.995417 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:02:19.006466 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:02:19.134131 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:02:19.250043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:19.698674 run create_hlr_db(pid=9818): Launched 02:02:19.814836 bus /sierra_2: Setting Powered False 02:02:20.876418 run create_hlr_db(pid=9818): Terminated: ok {rc=0} 02:02:21.296917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9820): Launched 02:02:21.627709 run osmo-hlr_10.42.42.2(pid=9821): Launched 02:02:21.755386 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:22.294348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9823): Launched 02:02:22.624162 run osmo-stp_10.42.42.5(pid=9824): Launched 02:02:22.750079 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:23.315007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9826): Launched 02:02:23.646564 run osmo-msc_10.42.42.6(pid=9827): Launched 02:02:23.831949 run osmo-stp_10.42.42.5(pid=9824): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9824)] 02:02:23.970827 run osmo-stp_10.42.42.5(pid=9824): stdout: | (launched: 2022-12-09_02:02:22.563624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:24.109896 run osmo-stp_10.42.42.5(pid=9824): stderr: | 20221209020222759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020222759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020222760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020222760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020222761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020222761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020222761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:24.247336 run osmo-stp_10.42.42.5(pid=9824): stdout: | (launched: 2022-12-09_02:02:22.563624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:24.378162 run osmo-stp_10.42.42.5(pid=9824): stderr: | 20221209020222759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020222759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020222760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020222760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020222761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020222761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020222761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:24.534680 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9824): Process ended prematurely: osmo-stp_10.42.42.5(pid=9824) [trial-2352↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9824)] [trial-2352↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 02:02:24.543603 tst handover.py:18: Test FAILED (6.6 sec) 02:02:24.571160 run osmo-hlr_10.42.42.2(pid=9821): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9821)] 02:02:24.621688 run osmo-hlr_10.42.42.2(pid=9821): stdout: | (launched: 2022-12-09_02:02:21.567065) 02:02:24.673747 run osmo-hlr_10.42.42.2(pid=9821): stderr: | 20221209020221769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020221769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020221769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020221769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020221769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020221769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020221782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020221790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020221790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020221790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:24.746239 run osmo-msc_10.42.42.6(pid=9827): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9827)] 02:02:24.796482 run osmo-msc_10.42.42.6(pid=9827): stdout: | (launched: 2022-12-09_02:02:23.585976) 02:02:24.848537 run osmo-msc_10.42.42.6(pid=9827): stderr: | 20221209020223912 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020223913 DLGLOBAL DEBUG validating counter group 0x7fc92b992c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020223913 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020223913 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020223913 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020223913 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020223915 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020223915 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020223915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020223915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:24.900737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9820): Terminating (SIGTERM) 02:02:24.942859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9823): Terminating (SIGTERM) 02:02:24.984607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9826): Terminating (SIGTERM) 02:02:25.026845 --- ParallelTerminationStrategy: PID 9820 died... 02:02:25.047026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9820): Terminated: ok {rc=0} 02:02:25.093446 --- ParallelTerminationStrategy: PID 9823 died... 02:02:25.112940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9823): Terminated: ok {rc=0} 02:02:25.159748 --- ParallelTerminationStrategy: PID 9826 died... 02:02:25.179493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9826): Terminated: ok {rc=0} 02:02:25.267761 bus /sierra_3: Setting Powered False 02:02:26.367677 bus /sierra_3: Setting Powered False 02:02:27.484058 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 02:02:28.756526 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:28.762648 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 02:02:28.827629 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:02:28.854869 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:02:28.909102 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 02:02:28.974616 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:02:29.001941 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:02:29.552591 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 02:02:29.557989 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:29.569511 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:02:29.618827 tst handover.py: using LAC 18309 02:02:29.748927 tst handover.py: using RAC 204 02:02:29.870336 tst handover.py: using CellId 18309 02:02:29.992639 tst handover.py: using BVCI 18310 02:02:30.104242 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:02:30.153486 tst handover.py: using LAC 18310 02:02:30.282612 tst handover.py: using RAC 205 02:02:30.410539 tst handover.py: using CellId 18310 02:02:30.543584 tst handover.py: using BVCI 18311 02:02:30.664488 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:30.676089 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:30.687333 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:30.698751 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:30.710115 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:30.721369 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:02:30.840178 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:02:30.984229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:31.479344 run create_hlr_db(pid=9832): Launched 02:02:31.622882 bus /sierra_2: Setting Powered False 02:02:32.684774 run create_hlr_db(pid=9832): Terminated: ok {rc=0} 02:02:33.105534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9834): Launched 02:02:33.435128 run osmo-hlr_10.42.42.2(pid=9835): Launched 02:02:33.560652 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:34.097354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9837): Launched 02:02:34.427209 run osmo-stp_10.42.42.5(pid=9838): Launched 02:02:34.553057 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:35.120006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9840): Launched 02:02:35.450555 run osmo-msc_10.42.42.6(pid=9841): Launched 02:02:35.636252 run osmo-stp_10.42.42.5(pid=9838): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9838)] 02:02:35.781200 run osmo-stp_10.42.42.5(pid=9838): stdout: | (launched: 2022-12-09_02:02:34.366940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:35.919739 run osmo-stp_10.42.42.5(pid=9838): stderr: | 20221209020234562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020234562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020234562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020234563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020234565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020234565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020234565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:36.057462 run osmo-stp_10.42.42.5(pid=9838): stdout: | (launched: 2022-12-09_02:02:34.366940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:36.188274 run osmo-stp_10.42.42.5(pid=9838): stderr: | 20221209020234562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020234562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020234562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020234563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020234565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020234565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020234565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:36.344472 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9838): Process ended prematurely: osmo-stp_10.42.42.5(pid=9838) [trial-2352↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9838)] [trial-2352↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 02:02:36.353334 tst handover.py:18: Test FAILED (6.8 sec) 02:02:36.381073 run osmo-hlr_10.42.42.2(pid=9835): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9835)] 02:02:36.431591 run osmo-hlr_10.42.42.2(pid=9835): stdout: | (launched: 2022-12-09_02:02:33.374475) 02:02:36.484064 run osmo-hlr_10.42.42.2(pid=9835): stderr: | 20221209020233575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020233575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020233575 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020233575 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020233575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020233575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020233591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020233600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020233601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020233601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:36.556517 run osmo-msc_10.42.42.6(pid=9841): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9841)] 02:02:36.607163 run osmo-msc_10.42.42.6(pid=9841): stdout: | (launched: 2022-12-09_02:02:35.390134) 02:02:36.659413 run osmo-msc_10.42.42.6(pid=9841): stderr: | 20221209020235717 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020235717 DLGLOBAL DEBUG validating counter group 0x7f63e9488c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020235717 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020235717 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020235718 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020235718 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020235719 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020235720 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020235720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020235720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:36.711589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9834): Terminating (SIGTERM) 02:02:36.753708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9837): Terminating (SIGTERM) 02:02:36.795956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9840): Terminating (SIGTERM) 02:02:36.838640 --- ParallelTerminationStrategy: PID 9834 died... 02:02:36.858895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9834): Terminated: ok {rc=0} 02:02:36.905631 --- ParallelTerminationStrategy: PID 9837 died... 02:02:36.925410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9837): Terminated: ok {rc=0} 02:02:36.976650 --- ParallelTerminationStrategy: PID 9840 died... 02:02:36.996350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9840): Terminated: ok {rc=0} 02:02:37.084231 bus /sierra_3: Setting Powered False 02:02:38.185245 bus /sierra_3: Setting Powered False 02:02:39.304435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 02:02:40.576156 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:40.581207 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:02:40.631111 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:02:40.657530 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:02:40.710465 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:02:40.760196 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:02:40.786495 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:02:41.334715 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 02:02:41.339855 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:41.350621 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 02:02:41.397171 tst handover.py: using LAC 18311 02:02:41.516063 tst handover.py: using RAC 206 02:02:41.635501 tst handover.py: using CellId 18311 02:02:41.757752 tst handover.py: using BVCI 18312 02:02:41.868727 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 02:02:41.902658 tst handover.py: using LAC 18312 02:02:42.022330 tst handover.py: using RAC 207 02:02:42.145554 tst handover.py: using CellId 18312 02:02:42.265819 tst handover.py: using BVCI 18313 02:02:42.379064 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:42.389808 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:42.400274 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:42.411648 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:42.422958 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:42.434126 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 02:02:42.548625 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 02:02:42.667732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:43.146571 run create_hlr_db(pid=9847): Launched 02:02:43.279720 bus /sierra_2: Setting Powered False 02:02:44.344923 run create_hlr_db(pid=9847): Terminated: ok {rc=0} 02:02:44.772629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9849): Launched 02:02:45.100439 run osmo-hlr_10.42.42.2(pid=9850): Launched 02:02:45.225792 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:45.760028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9852): Launched 02:02:46.101169 run osmo-stp_10.42.42.5(pid=9853): Launched 02:02:46.350037 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:47.047911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9855): Launched 02:02:47.371398 run osmo-msc_10.42.42.6(pid=9856): Launched 02:02:47.542009 run osmo-stp_10.42.42.5(pid=9853): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9853)] 02:02:47.670808 run osmo-stp_10.42.42.5(pid=9853): stdout: | (launched: 2022-12-09_02:02:46.038266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:47.798323 run osmo-stp_10.42.42.5(pid=9853): stderr: | 20221209020246376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020246377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020246377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020246377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020246378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020246378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020246378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:47.923539 run osmo-stp_10.42.42.5(pid=9853): stdout: | (launched: 2022-12-09_02:02:46.038266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:48.043116 run osmo-stp_10.42.42.5(pid=9853): stderr: | 20221209020246376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020246377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020246377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020246377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020246378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020246378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020246378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:48.186697 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9853): Process ended prematurely: osmo-stp_10.42.42.5(pid=9853) [trial-2352↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9853)] [trial-2352↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 02:02:48.194882 tst handover.py:18: Test FAILED (6.8 sec) 02:02:48.221257 run osmo-hlr_10.42.42.2(pid=9850): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9850)] 02:02:48.268769 run osmo-hlr_10.42.42.2(pid=9850): stdout: | (launched: 2022-12-09_02:02:45.040302) 02:02:48.318654 run osmo-hlr_10.42.42.2(pid=9850): stderr: | 20221209020245239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020245240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020245240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020245240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020245240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020245240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020245252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020245260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020245260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020245260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:48.387599 run osmo-msc_10.42.42.6(pid=9856): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9856)] 02:02:48.435235 run osmo-msc_10.42.42.6(pid=9856): stdout: | (launched: 2022-12-09_02:02:47.316061) 02:02:48.484475 run osmo-msc_10.42.42.6(pid=9856): stderr: | 20221209020247584 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020247584 DLGLOBAL DEBUG validating counter group 0x7fe988a04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020247584 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020247584 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020247584 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020247584 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020247586 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020247587 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020247587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020247587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:48.534034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9849): Terminating (SIGTERM) 02:02:48.573496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9852): Terminating (SIGTERM) 02:02:48.612911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9855): Terminating (SIGTERM) 02:02:48.652892 --- ParallelTerminationStrategy: PID 9849 died... 02:02:48.671914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9849): Terminated: ok {rc=0} 02:02:48.715959 --- ParallelTerminationStrategy: PID 9852 died... 02:02:48.734419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9852): Terminated: ok {rc=0} 02:02:48.778883 --- ParallelTerminationStrategy: PID 9855 died... 02:02:48.797745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9855): Terminated: ok {rc=0} 02:02:48.884532 bus /sierra_3: Setting Powered False 02:02:49.983389 bus /sierra_3: Setting Powered False 02:02:51.097281 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 02:02:52.361523 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:52.368190 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:02:52.431713 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:02:52.458925 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:02:52.518749 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:02:52.582638 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:02:52.609948 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:02:53.157275 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 02:02:53.162605 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:53.173844 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:02:53.222885 tst handover.py: using LAC 18313 02:02:53.345092 tst handover.py: using RAC 208 02:02:53.463600 tst handover.py: using CellId 18313 02:02:53.582504 tst handover.py: using BVCI 18314 02:02:53.701208 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:02:53.750687 tst handover.py: using LAC 18314 02:02:53.878670 tst handover.py: using RAC 209 02:02:54.004508 tst handover.py: using CellId 18314 02:02:54.130987 tst handover.py: using BVCI 18315 02:02:54.249702 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:54.260882 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:54.271979 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:54.282973 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:54.294053 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:54.305028 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:02:54.421275 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:02:54.540030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:55.013746 run create_hlr_db(pid=9861): Launched 02:02:55.145622 bus /sierra_2: Setting Powered False 02:02:56.209872 run create_hlr_db(pid=9861): Terminated: ok {rc=0} 02:02:56.633721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9863): Launched 02:02:56.958067 run osmo-hlr_10.42.42.2(pid=9864): Launched 02:02:57.081580 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:57.613412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9866): Launched 02:02:57.937296 run osmo-stp_10.42.42.5(pid=9867): Launched 02:02:58.060844 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:58.621064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9869): Launched 02:02:58.944881 run osmo-msc_10.42.42.6(pid=9870): Launched 02:02:59.125238 run osmo-stp_10.42.42.5(pid=9867): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9867)] 02:02:59.261474 run osmo-stp_10.42.42.5(pid=9867): stdout: | (launched: 2022-12-09_02:02:57.878282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:59.398230 run osmo-stp_10.42.42.5(pid=9867): stderr: | 20221209020258067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020258067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020258067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020258068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020258068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020258068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020258068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:59.534120 run osmo-stp_10.42.42.5(pid=9867): stdout: | (launched: 2022-12-09_02:02:57.878282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:59.663850 run osmo-stp_10.42.42.5(pid=9867): stderr: | 20221209020258067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020258067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020258067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020258068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020258068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020258068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020258068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:59.817688 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9867): Process ended prematurely: osmo-stp_10.42.42.5(pid=9867) [trial-2352↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9867)] [trial-2352↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 02:02:59.826726 tst handover.py:18: Test FAILED (6.7 sec) 02:02:59.854206 run osmo-hlr_10.42.42.2(pid=9864): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9864)] 02:02:59.904003 run osmo-hlr_10.42.42.2(pid=9864): stdout: | (launched: 2022-12-09_02:02:56.899007) 02:02:59.955758 run osmo-hlr_10.42.42.2(pid=9864): stderr: | 20221209020257095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020257095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020257095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020257095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020257095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020257095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020257108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020257117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020257117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020257117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:00.027285 run osmo-msc_10.42.42.6(pid=9870): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9870)] 02:03:00.076787 run osmo-msc_10.42.42.6(pid=9870): stdout: | (launched: 2022-12-09_02:02:58.885800) 02:03:00.127915 run osmo-msc_10.42.42.6(pid=9870): stderr: | 20221209020259207 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020259207 DLGLOBAL DEBUG validating counter group 0x7fd27949dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020259207 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020259207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020259207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020259207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020259209 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020259209 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020259210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020259210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:00.179553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9863): Terminating (SIGTERM) 02:03:00.220931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9866): Terminating (SIGTERM) 02:03:00.262198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9869): Terminating (SIGTERM) 02:03:00.303718 --- ParallelTerminationStrategy: PID 9863 died... 02:03:00.323284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9863): Terminated: ok {rc=0} 02:03:00.369101 --- ParallelTerminationStrategy: PID 9866 died... 02:03:00.388674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9866): Terminated: ok {rc=0} 02:03:00.434689 --- ParallelTerminationStrategy: PID 9869 died... 02:03:00.454291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9869): Terminated: ok {rc=0} 02:03:00.541220 bus /sierra_3: Setting Powered False 02:03:01.640624 bus /sierra_3: Setting Powered False 02:03:02.761237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 02:03:04.028826 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:04.033909 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:03:04.094813 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:03:04.120883 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:03:04.172324 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:03:04.233436 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:03:04.259661 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:03:04.809072 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 02:03:04.814090 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:04.824834 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:03:04.871946 tst handover.py: using LAC 18315 02:03:04.990058 tst handover.py: using RAC 210 02:03:05.112807 tst handover.py: using CellId 18315 02:03:05.230997 tst handover.py: using BVCI 18316 02:03:05.340257 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:03:05.389198 tst handover.py: using LAC 18316 02:03:05.507165 tst handover.py: using RAC 211 02:03:05.623895 tst handover.py: using CellId 18316 02:03:05.741257 tst handover.py: using BVCI 18317 02:03:05.850258 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:05.860904 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:05.871488 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:05.882487 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:05.893491 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:05.907760 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:03:06.024312 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:03:06.139491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:06.580636 run create_hlr_db(pid=9876): Launched 02:03:06.696487 bus /sierra_2: Setting Powered False 02:03:07.757282 run create_hlr_db(pid=9876): Terminated: ok {rc=0} 02:03:08.169990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9878): Launched 02:03:08.495484 run osmo-hlr_10.42.42.2(pid=9879): Launched 02:03:08.619936 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:09.151604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9881): Launched 02:03:09.474599 run osmo-stp_10.42.42.5(pid=9882): Launched 02:03:09.599075 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:10.157264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9884): Launched 02:03:10.480689 run osmo-msc_10.42.42.6(pid=9885): Launched 02:03:10.663247 run osmo-stp_10.42.42.5(pid=9882): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9882)] 02:03:10.800150 run osmo-stp_10.42.42.5(pid=9882): stdout: | (launched: 2022-12-09_02:03:09.415331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:10.936258 run osmo-stp_10.42.42.5(pid=9882): stderr: | 20221209020309605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020309605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020309605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020309606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020309606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020309606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020309606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:11.071727 run osmo-stp_10.42.42.5(pid=9882): stdout: | (launched: 2022-12-09_02:03:09.415331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:11.200631 run osmo-stp_10.42.42.5(pid=9882): stderr: | 20221209020309605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020309605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020309605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020309606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020309606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020309606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020309606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:11.354846 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9882): Process ended prematurely: osmo-stp_10.42.42.5(pid=9882) [trial-2352↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9882)] [trial-2352↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 02:03:11.363588 tst handover.py:18: Test FAILED (6.5 sec) 02:03:11.390942 run osmo-hlr_10.42.42.2(pid=9879): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9879)] 02:03:11.440857 run osmo-hlr_10.42.42.2(pid=9879): stdout: | (launched: 2022-12-09_02:03:08.436081) 02:03:11.492405 run osmo-hlr_10.42.42.2(pid=9879): stderr: | 20221209020308632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020308632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020308632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020308632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020308632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020308632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020308645 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020308653 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020308654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020308654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:11.564379 run osmo-msc_10.42.42.6(pid=9885): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9885)] 02:03:11.614331 run osmo-msc_10.42.42.6(pid=9885): stdout: | (launched: 2022-12-09_02:03:10.420887) 02:03:11.665732 run osmo-msc_10.42.42.6(pid=9885): stderr: | 20221209020310742 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020310742 DLGLOBAL DEBUG validating counter group 0x7f6770b4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020310742 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020310742 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020310742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020310742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020310744 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020310744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020310745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020310745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:11.717474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9878): Terminating (SIGTERM) 02:03:11.759143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9881): Terminating (SIGTERM) 02:03:11.800647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9884): Terminating (SIGTERM) 02:03:11.842165 --- ParallelTerminationStrategy: PID 9878 died... 02:03:11.862081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9878): Terminated: ok {rc=0} 02:03:11.908207 --- ParallelTerminationStrategy: PID 9881 died... 02:03:11.927825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9881): Terminated: ok {rc=0} 02:03:11.973445 --- ParallelTerminationStrategy: PID 9884 died... 02:03:11.992995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9884): Terminated: ok {rc=0} 02:03:12.081597 bus /sierra_3: Setting Powered False 02:03:13.181544 bus /sierra_3: Setting Powered False 02:03:14.298994 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 02:03:15.570879 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:15.576277 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 02:03:15.637110 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:03:15.664457 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:03:15.718589 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 02:03:15.780657 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:03:15.807845 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:03:16.381862 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 02:03:16.390457 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:03:16.405931 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:03:16.462502 tst handover.py: using LAC 18317 02:03:16.603265 tst handover.py: using RAC 212 02:03:16.767931 tst handover.py: using CellId 18317 02:03:16.893919 tst handover.py: using BVCI 18318 02:03:17.038672 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:03:17.088868 tst handover.py: using LAC 18318 02:03:17.247190 tst handover.py: using RAC 213 02:03:17.366747 tst handover.py: using CellId 18318 02:03:17.485878 tst handover.py: using BVCI 18319 02:03:17.604786 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:03:17.616646 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:03:17.628368 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:03:17.640141 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:03:17.652024 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:03:17.663665 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:03:17.778196 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:03:17.896050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:18.375185 run create_hlr_db(pid=9890): Launched 02:03:18.506740 bus /sierra_2: Setting Powered False 02:03:19.570603 run create_hlr_db(pid=9890): Terminated: ok {rc=0} 02:03:19.994197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9892): Launched 02:03:20.318239 run osmo-hlr_10.42.42.2(pid=9893): Launched 02:03:20.442385 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:20.971121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9895): Launched 02:03:21.296043 run osmo-stp_10.42.42.5(pid=9896): Launched 02:03:21.419416 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:21.980760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9898): Launched 02:03:22.304525 run osmo-msc_10.42.42.6(pid=9899): Launched 02:03:22.485833 run osmo-stp_10.42.42.5(pid=9896): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9896)] 02:03:22.622824 run osmo-stp_10.42.42.5(pid=9896): stdout: | (launched: 2022-12-09_02:03:21.235695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:22.759782 run osmo-stp_10.42.42.5(pid=9896): stderr: | 20221209020321425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020321426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020321426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020321427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020321427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020321427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020321427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:22.895569 run osmo-stp_10.42.42.5(pid=9896): stdout: | (launched: 2022-12-09_02:03:21.235695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:23.024421 run osmo-stp_10.42.42.5(pid=9896): stderr: | 20221209020321425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020321426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020321426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020321427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020321427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020321427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020321427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:23.179140 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9896): Process ended prematurely: osmo-stp_10.42.42.5(pid=9896) [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9896)] [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 02:03:23.188062 tst handover.py:18: Test FAILED (6.8 sec) 02:03:23.215828 run osmo-hlr_10.42.42.2(pid=9893): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9893)] 02:03:23.266169 run osmo-hlr_10.42.42.2(pid=9893): stdout: | (launched: 2022-12-09_02:03:20.259291) 02:03:23.317964 run osmo-hlr_10.42.42.2(pid=9893): stderr: | 20221209020320453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020320453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020320453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020320453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020320453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020320453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020320465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020320475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020320475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020320475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:23.390393 run osmo-msc_10.42.42.6(pid=9899): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9899)] 02:03:23.440502 run osmo-msc_10.42.42.6(pid=9899): stdout: | (launched: 2022-12-09_02:03:22.245732) 02:03:23.492095 run osmo-msc_10.42.42.6(pid=9899): stderr: | 20221209020322566 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020322566 DLGLOBAL DEBUG validating counter group 0x7f8ad8e53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020322566 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020322566 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020322566 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020322566 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020322568 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020322568 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020322569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020322569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:23.544142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9892): Terminating (SIGTERM) 02:03:23.585728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9895): Terminating (SIGTERM) 02:03:23.627763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9898): Terminating (SIGTERM) 02:03:23.670215 --- ParallelTerminationStrategy: PID 9892 died... 02:03:23.690162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9892): Terminated: ok {rc=0} 02:03:23.736545 --- ParallelTerminationStrategy: PID 9895 died... 02:03:23.756301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9895): Terminated: ok {rc=0} 02:03:23.802625 --- ParallelTerminationStrategy: PID 9898 died... 02:03:23.822606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9898): Terminated: ok {rc=0} 02:03:23.910329 bus /sierra_3: Setting Powered False 02:03:25.010174 bus /sierra_3: Setting Powered False 02:03:26.126908 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 02:03:27.398863 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:27.404274 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:03:27.451400 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:03:27.478706 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:03:27.530933 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:03:27.578265 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:03:27.605277 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:03:28.159099 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 02:03:28.164458 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:28.175822 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 02:03:28.220406 tst handover.py: using LAC 18319 02:03:28.346939 tst handover.py: using RAC 214 02:03:28.482836 tst handover.py: using CellId 18319 02:03:28.612369 tst handover.py: using BVCI 18320 02:03:28.731503 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 02:03:28.770865 tst handover.py: using LAC 18320 02:03:28.897486 tst handover.py: using RAC 215 02:03:29.022301 tst handover.py: using CellId 18320 02:03:29.148894 tst handover.py: using BVCI 18321 02:03:29.267244 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:29.278606 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:29.289785 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:29.301084 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:29.312257 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:29.323460 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 02:03:29.438309 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 02:03:29.556517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:30.030516 run create_hlr_db(pid=9904): Launched 02:03:30.161848 bus /sierra_2: Setting Powered False 02:03:31.223547 run create_hlr_db(pid=9904): Terminated: ok {rc=0} 02:03:31.644116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9906): Launched 02:03:31.965298 run osmo-hlr_10.42.42.2(pid=9907): Launched 02:03:32.157579 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:32.666019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9909): Launched 02:03:32.968115 run osmo-stp_10.42.42.5(pid=9910): Launched 02:03:33.083171 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:33.601096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9912): Launched 02:03:33.903175 run osmo-msc_10.42.42.6(pid=9913): Launched 02:03:34.072207 run osmo-stp_10.42.42.5(pid=9910): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9910)] 02:03:34.200189 run osmo-stp_10.42.42.5(pid=9910): stdout: | (launched: 2022-12-09_02:03:32.912881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:34.327741 run osmo-stp_10.42.42.5(pid=9910): stderr: | 20221209020333080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020333081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020333081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020333081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020333082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020333082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020333082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:34.453442 run osmo-stp_10.42.42.5(pid=9910): stdout: | (launched: 2022-12-09_02:03:32.912881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:34.573765 run osmo-stp_10.42.42.5(pid=9910): stderr: | 20221209020333080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020333081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020333081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020333081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020333082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020333082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020333082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:34.717410 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9910): Process ended prematurely: osmo-stp_10.42.42.5(pid=9910) [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9910)] [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 02:03:34.725698 tst handover.py:18: Test FAILED (6.6 sec) 02:03:34.752349 run osmo-hlr_10.42.42.2(pid=9907): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9907)] 02:03:34.800270 run osmo-hlr_10.42.42.2(pid=9907): stdout: | (launched: 2022-12-09_02:03:31.903595) 02:03:34.849909 run osmo-hlr_10.42.42.2(pid=9907): stderr: | 20221209020332202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020332202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020332202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020332203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020332203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020332203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020332214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020332222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020332222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020332222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:34.918804 run osmo-msc_10.42.42.6(pid=9913): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9913)] 02:03:34.966483 run osmo-msc_10.42.42.6(pid=9913): stdout: | (launched: 2022-12-09_02:03:33.847897) 02:03:35.015749 run osmo-msc_10.42.42.6(pid=9913): stderr: | 20221209020334115 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020334115 DLGLOBAL DEBUG validating counter group 0x7feb46effc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020334115 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020334115 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020334115 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020334116 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020334117 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020334118 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020334118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020334118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:35.065519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9906): Terminating (SIGTERM) 02:03:35.105221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9909): Terminating (SIGTERM) 02:03:35.145512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9912): Terminating (SIGTERM) 02:03:35.185551 --- ParallelTerminationStrategy: PID 9906 died... 02:03:35.204711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9906): Terminated: ok {rc=0} 02:03:35.249314 --- ParallelTerminationStrategy: PID 9909 died... 02:03:35.267841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9909): Terminated: ok {rc=0} 02:03:35.312246 --- ParallelTerminationStrategy: PID 9912 died... 02:03:35.330951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9912): Terminated: ok {rc=0} 02:03:35.416462 bus /sierra_3: Setting Powered False 02:03:36.515698 bus /sierra_3: Setting Powered False 02:03:37.632432 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 02:03:38.882016 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:38.887154 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:03:38.945014 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:03:38.971315 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:03:39.022606 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:03:39.080658 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:03:39.106825 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:03:39.658591 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 02:03:39.663767 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:39.674712 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:03:39.720924 tst handover.py: using LAC 18321 02:03:39.839429 tst handover.py: using RAC 216 02:03:39.956086 tst handover.py: using CellId 18321 02:03:40.075710 tst handover.py: using BVCI 18322 02:03:40.186633 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:03:40.233310 tst handover.py: using LAC 18322 02:03:40.351627 tst handover.py: using RAC 217 02:03:40.467902 tst handover.py: using CellId 18322 02:03:40.585643 tst handover.py: using BVCI 18323 02:03:40.695052 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:40.706024 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:40.716783 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:40.727903 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:40.738937 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:40.749873 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:03:40.867972 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:03:40.987274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:41.461693 run create_hlr_db(pid=9918): Launched 02:03:41.594755 bus /sierra_2: Setting Powered False 02:03:42.659060 run create_hlr_db(pid=9918): Terminated: ok {rc=0} 02:03:43.081729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9920): Launched 02:03:43.406057 run osmo-hlr_10.42.42.2(pid=9921): Launched 02:03:43.530016 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:44.058749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9923): Launched 02:03:44.383499 run osmo-stp_10.42.42.5(pid=9924): Launched 02:03:44.507078 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:45.064286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9926): Launched 02:03:45.388494 run osmo-msc_10.42.42.6(pid=9927): Launched 02:03:45.568847 run osmo-stp_10.42.42.5(pid=9924): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9924)] 02:03:45.705430 run osmo-stp_10.42.42.5(pid=9924): stdout: | (launched: 2022-12-09_02:03:44.324306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:45.874459 run osmo-stp_10.42.42.5(pid=9924): stderr: | 20221209020344514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020344514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020344514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020344515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020344515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020344515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020344515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:46.015356 run osmo-stp_10.42.42.5(pid=9924): stdout: | (launched: 2022-12-09_02:03:44.324306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:46.140710 run osmo-stp_10.42.42.5(pid=9924): stderr: | 20221209020344514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020344514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020344514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020344515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020344515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020344515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020344515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:46.290056 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9924): Process ended prematurely: osmo-stp_10.42.42.5(pid=9924) [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9924)] [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 02:03:46.299339 tst handover.py:18: Test FAILED (6.6 sec) 02:03:46.328904 run osmo-hlr_10.42.42.2(pid=9921): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9921)] 02:03:46.380198 run osmo-hlr_10.42.42.2(pid=9921): stdout: | (launched: 2022-12-09_02:03:43.347226) 02:03:46.432565 run osmo-hlr_10.42.42.2(pid=9921): stderr: | 20221209020343541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020343542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020343542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020343542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020343542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020343542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020343555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020343563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020343563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020343563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:46.506396 run osmo-msc_10.42.42.6(pid=9927): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9927)] 02:03:46.556900 run osmo-msc_10.42.42.6(pid=9927): stdout: | (launched: 2022-12-09_02:03:45.329702) 02:03:46.609435 run osmo-msc_10.42.42.6(pid=9927): stderr: | 20221209020345650 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020345650 DLGLOBAL DEBUG validating counter group 0x7f94f92dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020345650 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020345650 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020345650 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020345651 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020345652 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020345653 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020345653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020345653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:46.662927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9920): Terminating (SIGTERM) 02:03:46.707301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9923): Terminating (SIGTERM) 02:03:46.752345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9926): Terminating (SIGTERM) 02:03:46.798559 --- ParallelTerminationStrategy: PID 9920 died... 02:03:46.818772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9920): Terminated: ok {rc=0} 02:03:46.868940 --- ParallelTerminationStrategy: PID 9923 died... 02:03:46.889761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9923): Terminated: ok {rc=0} 02:03:46.937464 --- ParallelTerminationStrategy: PID 9926 died... 02:03:46.956868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9926): Terminated: ok {rc=0} 02:03:47.048687 bus /sierra_3: Setting Powered False 02:03:48.146746 bus /sierra_3: Setting Powered False 02:03:49.262327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 02:03:50.535328 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:50.540819 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:03:50.600274 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:03:50.627760 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:03:50.680737 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:03:50.739358 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:03:50.766385 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:03:51.320119 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 02:03:51.325538 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:51.336798 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:03:51.381512 tst handover.py: using LAC 18323 02:03:51.501459 tst handover.py: using RAC 218 02:03:51.628480 tst handover.py: using CellId 18323 02:03:51.755249 tst handover.py: using BVCI 18324 02:03:51.874241 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:03:51.923438 tst handover.py: using LAC 18324 02:03:52.051554 tst handover.py: using RAC 219 02:03:52.182398 tst handover.py: using CellId 18324 02:03:52.308525 tst handover.py: using BVCI 18325 02:03:52.426073 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:52.437522 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:52.448651 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:52.459997 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:52.471231 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:52.482556 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:03:52.598254 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:03:52.715957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:53.189618 run create_hlr_db(pid=9932): Launched 02:03:53.321672 bus /sierra_2: Setting Powered False 02:03:54.386623 run create_hlr_db(pid=9932): Terminated: ok {rc=0} 02:03:54.810257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9934): Launched 02:03:55.135149 run osmo-hlr_10.42.42.2(pid=9935): Launched 02:03:55.258962 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:55.788843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9937): Launched 02:03:56.113843 run osmo-stp_10.42.42.5(pid=9938): Launched 02:03:56.238228 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:56.796486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9940): Launched 02:03:57.120618 run osmo-msc_10.42.42.6(pid=9941): Launched 02:03:57.300665 run osmo-stp_10.42.42.5(pid=9938): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9938)] 02:03:57.436561 run osmo-stp_10.42.42.5(pid=9938): stdout: | (launched: 2022-12-09_02:03:56.054349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:57.572586 run osmo-stp_10.42.42.5(pid=9938): stderr: | 20221209020356242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020356243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020356243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020356243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020356244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020356244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020356244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:57.708127 run osmo-stp_10.42.42.5(pid=9938): stdout: | (launched: 2022-12-09_02:03:56.054349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:57.836651 run osmo-stp_10.42.42.5(pid=9938): stderr: | 20221209020356242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020356243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020356243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020356243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020356244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020356244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020356244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:57.990476 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9938): Process ended prematurely: osmo-stp_10.42.42.5(pid=9938) [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9938)] [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 02:03:57.999094 tst handover.py:18: Test FAILED (6.7 sec) 02:03:58.026678 run osmo-hlr_10.42.42.2(pid=9935): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9935)] 02:03:58.076614 run osmo-hlr_10.42.42.2(pid=9935): stdout: | (launched: 2022-12-09_02:03:55.076237) 02:03:58.128709 run osmo-hlr_10.42.42.2(pid=9935): stderr: | 20221209020355271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020355271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020355271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020355271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020355271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020355272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020355285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020355293 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020355293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020355293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:58.201180 run osmo-msc_10.42.42.6(pid=9941): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9941)] 02:03:58.250993 run osmo-msc_10.42.42.6(pid=9941): stdout: | (launched: 2022-12-09_02:03:57.060649) 02:03:58.302610 run osmo-msc_10.42.42.6(pid=9941): stderr: | 20221209020357382 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020357382 DLGLOBAL DEBUG validating counter group 0x7fca7f424c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020357382 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020357382 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020357382 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020357382 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020357384 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020357384 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020357385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020357385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:58.354706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9934): Terminating (SIGTERM) 02:03:58.396196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9937): Terminating (SIGTERM) 02:03:58.437934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9940): Terminating (SIGTERM) 02:03:58.479893 --- ParallelTerminationStrategy: PID 9934 died... 02:03:58.499512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9934): Terminated: ok {rc=0} 02:03:58.545664 --- ParallelTerminationStrategy: PID 9937 died... 02:03:58.564919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9937): Terminated: ok {rc=0} 02:03:58.610953 --- ParallelTerminationStrategy: PID 9940 died... 02:03:58.630787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9940): Terminated: ok {rc=0} 02:03:58.718846 bus /sierra_3: Setting Powered False 02:03:59.816114 bus /sierra_3: Setting Powered False 02:04:00.941726 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 02:04:02.240303 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:02.246193 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:04:02.302560 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:04:02.329842 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:04:02.383167 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:04:02.434569 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:04:02.460696 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:04:03.009073 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 02:04:03.014264 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:04:03.025138 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 02:04:03.073489 tst handover.py: using LAC 18325 02:04:03.202272 tst handover.py: using RAC 220 02:04:03.330267 tst handover.py: using CellId 18325 02:04:03.463188 tst handover.py: using BVCI 18326 02:04:03.581923 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 02:04:03.616640 tst handover.py: using LAC 18326 02:04:03.743413 tst handover.py: using RAC 221 02:04:03.868267 tst handover.py: using CellId 18326 02:04:03.993759 tst handover.py: using BVCI 18327 02:04:04.111233 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:04:04.122604 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:04:04.133830 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:04:04.145044 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:04:04.156376 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:04:04.167729 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 02:04:04.283518 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 02:04:04.397576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:04:04.842317 run create_hlr_db(pid=9946): Launched 02:04:04.958228 bus /sierra_2: Setting Powered False 02:04:06.018509 run create_hlr_db(pid=9946): Terminated: ok {rc=0} 02:04:06.415733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Launched 02:04:06.718683 run osmo-hlr_10.42.42.2(pid=9949): Launched 02:04:06.834304 run osmo-stp_10.42.42.5: Starting osmo-stp 02:04:07.338950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Launched 02:04:07.642283 run osmo-stp_10.42.42.5(pid=9952): Launched 02:04:07.758089 run osmo-msc_10.42.42.6: Starting osmo-msc 02:04:08.279728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9954): Launched 02:04:08.582888 run osmo-msc_10.42.42.6(pid=9955): Launched 02:04:08.752263 run osmo-stp_10.42.42.5(pid=9952): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] 02:04:08.881362 run osmo-stp_10.42.42.5(pid=9952): stdout: | (launched: 2022-12-09_02:04:07.586842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:09.009880 run osmo-stp_10.42.42.5(pid=9952): stderr: | 20221209020407756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020407756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020407756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020407757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020407757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020407757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020407757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:09.135612 run osmo-stp_10.42.42.5(pid=9952): stdout: | (launched: 2022-12-09_02:04:07.586842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:09.255720 run osmo-stp_10.42.42.5(pid=9952): stderr: | 20221209020407756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020407756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020407756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020407757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020407757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020407757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020407757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:09.399507 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9952): Process ended prematurely: osmo-stp_10.42.42.5(pid=9952) [trial-2352↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] [trial-2352↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 02:04:09.407656 tst handover.py:18: Test FAILED (6.4 sec) 02:04:09.434311 run osmo-hlr_10.42.42.2(pid=9949): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9949)] 02:04:09.482392 run osmo-hlr_10.42.42.2(pid=9949): stdout: | (launched: 2022-12-09_02:04:06.663451) 02:04:09.532789 run osmo-hlr_10.42.42.2(pid=9949): stderr: | 20221209020406835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020406835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020406835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020406835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020406835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020406835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020406847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020406855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020406856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020406856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:04:09.602314 run osmo-msc_10.42.42.6(pid=9955): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9955)] 02:04:09.650535 run osmo-msc_10.42.42.6(pid=9955): stdout: | (launched: 2022-12-09_02:04:08.527175) 02:04:09.700197 run osmo-msc_10.42.42.6(pid=9955): stderr: | 20221209020408798 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020408798 DLGLOBAL DEBUG validating counter group 0x7f74b3283c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020408798 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020408798 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020408799 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020408799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020408801 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020408801 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020408801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020408801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:04:09.750397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Terminating (SIGTERM) 02:04:09.790283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Terminating (SIGTERM) 02:04:09.830289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9954): Terminating (SIGTERM) 02:04:09.870491 --- ParallelTerminationStrategy: PID 9948 died... 02:04:09.889667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Terminated: ok {rc=0} 02:04:09.934389 --- ParallelTerminationStrategy: PID 9951 died... 02:04:09.953036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Terminated: ok {rc=0} 02:04:09.997592 --- ParallelTerminationStrategy: PID 9954 died... 02:04:10.016310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9954): Terminated: ok {rc=0} 02:04:10.102146 bus /sierra_3: Setting Powered False 02:04:11.203288 bus /sierra_3: Setting Powered False 02:04:12.320895 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 02:04:13.582135 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:13.588246 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:04:13.654026 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:04:13.681741 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:04:13.735539 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:04:13.803999 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:04:13.830878 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:04:14.379748 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 02:04:14.385435 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:14.396712 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:04:14.446084 tst handover.py: using LAC 18327 02:04:14.574298 tst handover.py: using RAC 222 02:04:14.705432 tst handover.py: using CellId 18327 02:04:14.833477 tst handover.py: using BVCI 18328 02:04:14.951329 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:04:15.000606 tst handover.py: using LAC 18328 02:04:15.128695 tst handover.py: using RAC 223 02:04:15.255085 tst handover.py: using CellId 18328 02:04:15.383395 tst handover.py: using BVCI 18329 02:04:15.501213 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:15.512606 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:15.523964 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:15.535145 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:15.546458 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:15.557871 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:04:15.672350 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:04:15.787122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:04:16.281665 run create_hlr_db(pid=9960): Launched 02:04:16.432437 bus /sierra_2: Setting Powered False 02:04:17.497325 run create_hlr_db(pid=9960): Terminated: ok {rc=0} 02:04:17.904878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9962): Launched 02:04:18.207239 run osmo-hlr_10.42.42.2(pid=9963): Launched 02:04:18.322177 run osmo-stp_10.42.42.5: Starting osmo-stp 02:04:18.829706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9965): Launched 02:04:19.133253 run osmo-stp_10.42.42.5(pid=9966): Launched 02:04:19.248746 run osmo-msc_10.42.42.6: Starting osmo-msc 02:04:19.808329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9968): Launched 02:04:20.111101 run osmo-msc_10.42.42.6(pid=9969): Launched 02:04:20.282350 run osmo-stp_10.42.42.5(pid=9966): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9966)] 02:04:20.411415 run osmo-stp_10.42.42.5(pid=9966): stdout: | (launched: 2022-12-09_02:04:19.077594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:20.538603 run osmo-stp_10.42.42.5(pid=9966): stderr: | 20221209020419243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020419243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020419243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020419244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020419244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020419244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020419245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:20.664363 run osmo-stp_10.42.42.5(pid=9966): stdout: | (launched: 2022-12-09_02:04:19.077594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:20.784009 run osmo-stp_10.42.42.5(pid=9966): stderr: | 20221209020419243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020419243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020419243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020419244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020419244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020419244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020419245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:20.927386 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9966): Process ended prematurely: osmo-stp_10.42.42.5(pid=9966) [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9966)] [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 02:04:20.935598 tst handover.py:18: Test FAILED (6.5 sec) 02:04:20.961995 run osmo-hlr_10.42.42.2(pid=9963): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9963)] 02:04:21.010083 run osmo-hlr_10.42.42.2(pid=9963): stdout: | (launched: 2022-12-09_02:04:18.152151) 02:04:21.059717 run osmo-hlr_10.42.42.2(pid=9963): stderr: | 20221209020418324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020418324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020418324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020418324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020418324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020418324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020418336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020418345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020418346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020418346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:04:21.128905 run osmo-msc_10.42.42.6(pid=9969): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9969)] 02:04:21.176476 run osmo-msc_10.42.42.6(pid=9969): stdout: | (launched: 2022-12-09_02:04:20.055699) 02:04:21.225846 run osmo-msc_10.42.42.6(pid=9969): stderr: | 20221209020420323 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020420323 DLGLOBAL DEBUG validating counter group 0x7f1bfbfa8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020420323 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020420323 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020420323 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020420324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020420325 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020420326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020420326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020420326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:04:21.275479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9962): Terminating (SIGTERM) 02:04:21.315068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9965): Terminating (SIGTERM) 02:04:21.354769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9968): Terminating (SIGTERM) 02:04:21.394598 --- ParallelTerminationStrategy: PID 9962 died... 02:04:21.413571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9962): Terminated: ok {rc=0} 02:04:21.457795 --- ParallelTerminationStrategy: PID 9965 died... 02:04:21.476387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9965): Terminated: ok {rc=0} 02:04:21.520475 --- ParallelTerminationStrategy: PID 9968 died... 02:04:21.539113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9968): Terminated: ok {rc=0} 02:04:21.624555 bus /sierra_3: Setting Powered False 02:04:22.724485 bus /sierra_3: Setting Powered False 02:04:23.839272 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 02:04:25.111439 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:25.117113 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:04:25.181109 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:04:25.208476 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:04:25.262618 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:04:25.327133 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:04:25.354184 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:04:25.903767 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 02:04:25.909278 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:25.920492 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:25.970355 tst handover.py: using LAC 18329 02:04:26.098358 tst handover.py: using RAC 224 02:04:26.226504 tst handover.py: using CellId 18329 02:04:26.357497 tst handover.py: using BVCI 18330 02:04:26.475789 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:26.534138 tst handover.py: using LAC 18330 02:04:26.667655 tst handover.py: using RAC 225 02:04:26.793849 tst handover.py: using CellId 18330 02:04:26.921381 tst handover.py: using BVCI 18331 02:04:27.032754 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:27.043982 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:27.054835 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:27.066163 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:27.077518 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:27.088401 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:27.205231 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:27.325589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:04:27.799295 run create_hlr_db(pid=9974): Launched 02:04:27.931781 bus /sierra_2: Setting Powered False 02:04:28.996801 run create_hlr_db(pid=9974): Terminated: ok {rc=0} 02:04:29.420293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9976): Launched 02:04:29.744767 run osmo-hlr_10.42.42.2(pid=9977): Launched 02:04:29.868435 run osmo-stp_10.42.42.5: Starting osmo-stp 02:04:30.397552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9979): Launched 02:04:30.723672 run osmo-stp_10.42.42.5(pid=9980): Launched 02:04:30.878375 run osmo-msc_10.42.42.6: Starting osmo-msc 02:04:31.550035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9982): Launched 02:04:31.893254 run osmo-msc_10.42.42.6(pid=9983): Launched 02:04:32.212835 run osmo-stp_10.42.42.5(pid=9980): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9980)] 02:04:32.378310 run osmo-stp_10.42.42.5(pid=9980): stdout: | (launched: 2022-12-09_02:04:30.664240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:32.515016 run osmo-stp_10.42.42.5(pid=9980): stderr: | 20221209020430905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020430905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020430906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020430906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020430907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020430907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020430907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:32.650410 run osmo-stp_10.42.42.5(pid=9980): stdout: | (launched: 2022-12-09_02:04:30.664240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:32.779075 run osmo-stp_10.42.42.5(pid=9980): stderr: | 20221209020430905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020430905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020430906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020430906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020430907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020430907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020430907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:32.932874 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9980): Process ended prematurely: osmo-stp_10.42.42.5(pid=9980) [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9980)] [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 02:04:32.943029 tst handover.py:18: Test FAILED (7.0 sec) 02:04:32.970916 run osmo-hlr_10.42.42.2(pid=9977): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9977)] 02:04:33.020906 run osmo-hlr_10.42.42.2(pid=9977): stdout: | (launched: 2022-12-09_02:04:29.685622) 02:04:33.072632 run osmo-hlr_10.42.42.2(pid=9977): stderr: | 20221209020429884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020429884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020429884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020429884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020429884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020429884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020429896 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020429904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020429905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020429905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:04:33.145228 run osmo-msc_10.42.42.6(pid=9983): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9983)] 02:04:33.195281 run osmo-msc_10.42.42.6(pid=9983): stdout: | (launched: 2022-12-09_02:04:31.828639) 02:04:33.247221 run osmo-msc_10.42.42.6(pid=9983): stderr: | 20221209020432270 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020432270 DLGLOBAL DEBUG validating counter group 0x7f52ab9f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020432270 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020432270 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020432270 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020432271 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020432272 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020432273 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020432273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020432273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:04:33.299447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9976): Terminating (SIGTERM) 02:04:33.341194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9979): Terminating (SIGTERM) 02:04:33.382974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9982): Terminating (SIGTERM) 02:04:33.425090 --- ParallelTerminationStrategy: PID 9976 died... 02:04:33.445144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9976): Terminated: ok {rc=0} 02:04:33.491392 --- ParallelTerminationStrategy: PID 9979 died... 02:04:33.511092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9979): Terminated: ok {rc=0} 02:04:33.557324 --- ParallelTerminationStrategy: PID 9982 died... 02:04:33.577066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9982): Terminated: ok {rc=0} 02:04:33.664524 bus /sierra_3: Setting Powered False 02:04:34.763350 bus /sierra_3: Setting Powered False 02:04:35.878424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 02:04:37.151065 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:37.156638 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:04:37.208603 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:04:37.236051 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:04:37.290657 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:04:37.342405 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:04:37.369369 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:04:37.921654 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 02:04:37.927008 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:37.938208 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:04:37.973028 tst handover.py: using LAC 18331 02:04:38.097908 tst handover.py: using RAC 226 02:04:38.219469 tst handover.py: using CellId 18331 02:04:38.342977 tst handover.py: using BVCI 18332 02:04:38.454822 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:04:38.501778 tst handover.py: using LAC 18332 02:04:38.619800 tst handover.py: using RAC 227 02:04:38.737812 tst handover.py: using CellId 18332 02:04:38.857614 tst handover.py: using BVCI 18333 02:04:38.970250 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:38.981207 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:38.991914 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:39.003509 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:39.015028 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:39.026479 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:04:39.144780 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:04:39.260512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:04:39.703129 run create_hlr_db(pid=9989): Launched 02:04:39.818851 bus /sierra_2: Setting Powered False 02:04:40.879678 run create_hlr_db(pid=9989): Terminated: ok {rc=0} 02:04:41.275629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9991): Launched 02:04:41.578288 run osmo-hlr_10.42.42.2(pid=9992): Launched 02:04:41.694546 run osmo-stp_10.42.42.5: Starting osmo-stp 02:04:42.201974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9994): Launched 02:04:42.503803 run osmo-stp_10.42.42.5(pid=9995): Launched 02:04:42.620202 run osmo-msc_10.42.42.6: Starting osmo-msc 02:04:43.140489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9997): Launched 02:04:43.443262 run osmo-msc_10.42.42.6(pid=9998): Launched 02:04:43.612520 run osmo-stp_10.42.42.5(pid=9995): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9995)] 02:04:43.740421 run osmo-stp_10.42.42.5(pid=9995): stdout: | (launched: 2022-12-09_02:04:42.448167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:43.868210 run osmo-stp_10.42.42.5(pid=9995): stderr: | 20221209020442616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020442617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020442617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020442617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020442618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020442618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020442618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:43.993875 run osmo-stp_10.42.42.5(pid=9995): stdout: | (launched: 2022-12-09_02:04:42.448167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:44.113933 run osmo-stp_10.42.42.5(pid=9995): stderr: | 20221209020442616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020442617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020442617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020442617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020442618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020442618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020442618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:44.257668 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=9995): Process ended prematurely: osmo-stp_10.42.42.5(pid=9995) [trial-2352↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9995)] [trial-2352↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 02:04:44.266024 tst handover.py:18: Test FAILED (6.3 sec) 02:04:44.292274 run osmo-hlr_10.42.42.2(pid=9992): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9992)] 02:04:44.340318 run osmo-hlr_10.42.42.2(pid=9992): stdout: | (launched: 2022-12-09_02:04:41.522852) 02:04:44.390207 run osmo-hlr_10.42.42.2(pid=9992): stderr: | 20221209020441696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020441696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020441697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020441697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020441697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020441697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020441710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020441718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020441719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020441719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:04:44.459484 run osmo-msc_10.42.42.6(pid=9998): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9998)] 02:04:44.507546 run osmo-msc_10.42.42.6(pid=9998): stdout: | (launched: 2022-12-09_02:04:43.387716) 02:04:44.557220 run osmo-msc_10.42.42.6(pid=9998): stderr: | 20221209020443656 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020443657 DLGLOBAL DEBUG validating counter group 0x7fa902882c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020443657 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020443657 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020443657 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020443657 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020443659 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020443659 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020443659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020443659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:04:44.606914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9991): Terminating (SIGTERM) 02:04:44.646770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9994): Terminating (SIGTERM) 02:04:44.686767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9997): Terminating (SIGTERM) 02:04:44.726917 --- ParallelTerminationStrategy: PID 9991 died... 02:04:44.746074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9991): Terminated: ok {rc=0} 02:04:44.790653 --- ParallelTerminationStrategy: PID 9994 died... 02:04:44.809487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9994): Terminated: ok {rc=0} 02:04:44.853718 --- ParallelTerminationStrategy: PID 9997 died... 02:04:44.872416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9997): Terminated: ok {rc=0} 02:04:44.955625 bus /sierra_3: Setting Powered False 02:04:46.054579 bus /sierra_3: Setting Powered False 02:04:47.182745 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 02:04:48.432406 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:48.437741 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:04:48.487242 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:04:48.514190 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:04:48.566587 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:04:48.615955 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:04:48.642108 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:04:49.189624 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 02:04:49.196236 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:49.208542 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:49.243803 tst handover.py: using LAC 18333 02:04:49.371084 tst handover.py: using RAC 228 02:04:49.499632 tst handover.py: using CellId 18333 02:04:49.627259 tst handover.py: using BVCI 18334 02:04:49.746498 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:49.794946 tst handover.py: using LAC 18334 02:04:49.913783 tst handover.py: using RAC 229 02:04:50.035875 tst handover.py: using CellId 18334 02:04:50.156564 tst handover.py: using BVCI 18335 02:04:50.267950 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:50.278665 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:50.289148 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:50.299894 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:50.310744 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:50.321624 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:50.439488 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:50.555535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:04:50.998537 run create_hlr_db(pid=10003): Launched 02:04:51.113507 bus /sierra_2: Setting Powered False 02:04:52.173789 run create_hlr_db(pid=10003): Terminated: ok {rc=0} 02:04:52.588470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10005): Launched 02:04:52.912280 run osmo-hlr_10.42.42.2(pid=10006): Launched 02:04:53.035325 run osmo-stp_10.42.42.5: Starting osmo-stp 02:04:53.570058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10008): Launched 02:04:53.894987 run osmo-stp_10.42.42.5(pid=10009): Launched 02:04:54.018787 run osmo-msc_10.42.42.6: Starting osmo-msc 02:04:54.577140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10011): Launched 02:04:54.901088 run osmo-msc_10.42.42.6(pid=10012): Launched 02:04:55.082798 run osmo-stp_10.42.42.5(pid=10009): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10009)] 02:04:55.219288 run osmo-stp_10.42.42.5(pid=10009): stdout: | (launched: 2022-12-09_02:04:53.835831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:55.356612 run osmo-stp_10.42.42.5(pid=10009): stderr: | 20221209020454024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020454024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020454024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020454025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020454025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020454025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020454026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:55.491901 run osmo-stp_10.42.42.5(pid=10009): stdout: | (launched: 2022-12-09_02:04:53.835831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:55.620732 run osmo-stp_10.42.42.5(pid=10009): stderr: | 20221209020454024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020454024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020454024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020454025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020454025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020454025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020454026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:55.775281 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10009): Process ended prematurely: osmo-stp_10.42.42.5(pid=10009) [trial-2352↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10009)] [trial-2352↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 02:04:55.783991 tst handover.py:18: Test FAILED (6.6 sec) 02:04:55.811551 run osmo-hlr_10.42.42.2(pid=10006): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10006)] 02:04:55.861484 run osmo-hlr_10.42.42.2(pid=10006): stdout: | (launched: 2022-12-09_02:04:52.853522) 02:04:55.913224 run osmo-hlr_10.42.42.2(pid=10006): stderr: | 20221209020453049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020453049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020453049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020453049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020453049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020453050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020453063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020453072 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020453073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020453073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:04:55.985606 run osmo-msc_10.42.42.6(pid=10012): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10012)] 02:04:56.035594 run osmo-msc_10.42.42.6(pid=10012): stdout: | (launched: 2022-12-09_02:04:54.841955) 02:04:56.087367 run osmo-msc_10.42.42.6(pid=10012): stderr: | 20221209020455159 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020455159 DLGLOBAL DEBUG validating counter group 0x7f6e6561fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020455159 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020455159 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020455160 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020455160 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020455162 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020455162 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020455162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020455162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:04:56.139414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10005): Terminating (SIGTERM) 02:04:56.181254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10008): Terminating (SIGTERM) 02:04:56.223011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10011): Terminating (SIGTERM) 02:04:56.265296 --- ParallelTerminationStrategy: PID 10005 died... 02:04:56.285621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10005): Terminated: ok {rc=0} 02:04:56.332384 --- ParallelTerminationStrategy: PID 10008 died... 02:04:56.352201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10008): Terminated: ok {rc=0} 02:04:56.398755 --- ParallelTerminationStrategy: PID 10011 died... 02:04:56.418548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10011): Terminated: ok {rc=0} 02:04:56.507554 bus /sierra_3: Setting Powered False 02:04:57.605819 bus /sierra_3: Setting Powered False 02:04:58.722209 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2352 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 02:04:59.981574 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:59.987041 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:05:00.050189 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:05:00.077659 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:05:00.131937 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:05:00.195468 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:05:00.222540 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:05:00.771862 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2352 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 02:05:00.777346 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:05:00.788435 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:05:00.846260 tst handover.py: using LAC 18335 02:05:00.980932 tst handover.py: using RAC 230 02:05:01.111481 tst handover.py: using CellId 18335 02:05:01.237863 tst handover.py: using BVCI 18336 02:05:01.397459 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:05:01.457266 tst handover.py: using LAC 18336 02:05:01.594303 tst handover.py: using RAC 231 02:05:01.721702 tst handover.py: using CellId 18336 02:05:01.914739 tst handover.py: using BVCI 18337 02:05:02.075548 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:05:02.089873 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:05:02.105268 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:05:02.120388 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:05:02.137545 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:05:02.153851 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:05:02.298820 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:05:02.422814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:05:02.867496 run create_hlr_db(pid=10020): Launched 02:05:02.983020 bus /sierra_2: Setting Powered False 02:05:04.043964 run create_hlr_db(pid=10020): Terminated: ok {rc=0} 02:05:04.459250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10022): Launched 02:05:04.785205 run osmo-hlr_10.42.42.2(pid=10023): Launched 02:05:04.909156 run osmo-stp_10.42.42.5: Starting osmo-stp 02:05:05.443750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10025): Launched 02:05:05.768186 run osmo-stp_10.42.42.5(pid=10026): Launched 02:05:05.891928 run osmo-msc_10.42.42.6: Starting osmo-msc 02:05:06.450134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10028): Launched 02:05:06.775878 run osmo-msc_10.42.42.6(pid=10029): Launched 02:05:06.956606 run osmo-stp_10.42.42.5(pid=10026): ERR: Terminated: ERROR {rc=1} [trial-2352↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10026)] 02:05:07.093234 run osmo-stp_10.42.42.5(pid=10026): stdout: | (launched: 2022-12-09_02:05:05.709193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:05:07.229804 run osmo-stp_10.42.42.5(pid=10026): stderr: | 20221209020505902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020505902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020505902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020505903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020505903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020505903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020505903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:05:07.364915 run osmo-stp_10.42.42.5(pid=10026): stdout: | (launched: 2022-12-09_02:05:05.709193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:05:07.494071 run osmo-stp_10.42.42.5(pid=10026): stderr: | 20221209020505902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209020505902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209020505902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209020505903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209020505903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209020505903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209020505903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:05:07.648107 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10026): Process ended prematurely: osmo-stp_10.42.42.5(pid=10026) [trial-2352↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10026)] [trial-2352↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 02:05:07.657320 tst handover.py:18: Test FAILED (6.9 sec) 02:05:07.684883 run osmo-hlr_10.42.42.2(pid=10023): ERR: Terminated: ERROR {rc=237} [trial-2352↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10023)] 02:05:07.734954 run osmo-hlr_10.42.42.2(pid=10023): stdout: | (launched: 2022-12-09_02:05:04.725979) 02:05:07.786521 run osmo-hlr_10.42.42.2(pid=10023): stderr: | 20221209020504921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209020504921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209020504921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209020504921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209020504921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209020504921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209020504934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209020504943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209020504943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209020504943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:05:07.858375 run osmo-msc_10.42.42.6(pid=10029): ERR: Terminated: ERROR {rc=2} [trial-2352↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10029)] 02:05:07.908184 run osmo-msc_10.42.42.6(pid=10029): stdout: | (launched: 2022-12-09_02:05:06.716567) 02:05:07.959632 run osmo-msc_10.42.42.6(pid=10029): stderr: | 20221209020507036 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209020507037 DLGLOBAL DEBUG validating counter group 0x7f92b8061c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209020507037 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209020507037 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209020507037 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209020507037 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209020507039 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209020507039 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209020507039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209020507039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:05:08.011840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10022): Terminating (SIGTERM) 02:05:08.053506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10025): Terminating (SIGTERM) 02:05:08.095215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10028): Terminating (SIGTERM) 02:05:08.137342 --- ParallelTerminationStrategy: PID 10022 died... 02:05:08.156777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10022): Terminated: ok {rc=0} 02:05:08.203048 --- ParallelTerminationStrategy: PID 10025 died... 02:05:08.222538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10025): Terminated: ok {rc=0} 02:05:08.268368 --- ParallelTerminationStrategy: PID 10028 died... 02:05:08.287927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10028): Terminated: ok {rc=0} 02:05:08.375663 bus /sierra_3: Setting Powered False 02:05:09.473857 bus /sierra_3: Setting Powered False 02:05:10.589933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2352 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 02:05:11.861177 tst trial-2352: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352/run.2022-12-09_00-40-26/trial-2352.xml -------------------------------------------------------------------------------------------- trial-2352 FAIL -------------------------------------------------------------------------------------------- 02:05:13.789353 tst trial-2352: trial-2352: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.0 sec) Error: osmo-nitb_10.42.42.2(pid=2934): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2934) [trial-2352↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2934)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.5 sec) Error: osmo-stp_10.42.42.5(pid=2944): Process ended prematurely: osmo-stp_10.42.42.5(pid=2944) [trial-2352↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2944)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=2953): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2953) [trial-2352↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2953)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=2963): Process ended prematurely: osmo-stp_10.42.42.5(pid=2963) [trial-2352↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2963)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2977): Process ended prematurely: osmo-stp_10.42.42.5(pid=2977) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2977)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2988): Process ended prematurely: osmo-stp_10.42.42.5(pid=2988) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2988)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3002): Process ended prematurely: osmo-stp_10.42.42.5(pid=3002) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3002)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3013): Process ended prematurely: osmo-stp_10.42.42.5(pid=3013) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3013)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3027): Process ended prematurely: osmo-stp_10.42.42.5(pid=3027) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3027)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3038): Process ended prematurely: osmo-stp_10.42.42.5(pid=3038) [trial-2352↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3038)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3054): Process ended prematurely: osmo-stp_10.42.42.5(pid=3054) [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3054)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3065): Process ended prematurely: osmo-stp_10.42.42.5(pid=3065) [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3065)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3080): Process ended prematurely: osmo-stp_10.42.42.5(pid=3080) [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3080)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3091): Process ended prematurely: osmo-stp_10.42.42.5(pid=3091) [trial-2352↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3091)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3108): Process ended prematurely: osmo-stp_10.42.42.5(pid=3108) [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3108)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3119): Process ended prematurely: osmo-stp_10.42.42.5(pid=3119) [trial-2352↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3119)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3133): Process ended prematurely: osmo-stp_10.42.42.5(pid=3133) [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3133)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3144): Process ended prematurely: osmo-stp_10.42.42.5(pid=3144) [trial-2352↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3144)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3158): Process ended prematurely: osmo-stp_10.42.42.5(pid=3158) [trial-2352↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3158)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3169): Process ended prematurely: osmo-stp_10.42.42.5(pid=3169) [trial-2352↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3169)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=3187): Process ended prematurely: osmo-stp_10.42.42.5(pid=3187) [trial-2352↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3187)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=3199): Process ended prematurely: osmo-stp_10.42.42.5(pid=3199) [trial-2352↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3199)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=3217): Process ended prematurely: osmo-stp_10.42.42.5(pid=3217) [trial-2352↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3217)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3228): Process ended prematurely: osmo-stp_10.42.42.5(pid=3228) [trial-2352↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3228)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3238): Process ended prematurely: osmo-stp_10.42.42.5(pid=3238) [trial-2352↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3238)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=3255): Process ended prematurely: osmo-stp_10.42.42.5(pid=3255) [trial-2352↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3255)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=3269): Process ended prematurely: osmo-stp_10.42.42.5(pid=3269) [trial-2352↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3269)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=3287): Process ended prematurely: osmo-stp_10.42.42.5(pid=3287) [trial-2352↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3287)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=3297): Process ended prematurely: osmo-stp_10.42.42.5(pid=3297) [trial-2352↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3297)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3307): Process ended prematurely: osmo-stp_10.42.42.5(pid=3307) [trial-2352↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3307)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=3324): Process ended prematurely: osmo-stp_10.42.42.5(pid=3324) [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3324)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=3336): Process ended prematurely: osmo-stp_10.42.42.5(pid=3336) [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3336)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=3354): Process ended prematurely: osmo-stp_10.42.42.5(pid=3354) [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3354)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3364): Process ended prematurely: osmo-stp_10.42.42.5(pid=3364) [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3364)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3375): Process ended prematurely: osmo-stp_10.42.42.5(pid=3375) [trial-2352↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3375)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=3393): Process ended prematurely: osmo-stp_10.42.42.5(pid=3393) [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3393)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=3405): Process ended prematurely: osmo-stp_10.42.42.5(pid=3405) [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3405)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=3423): Process ended prematurely: osmo-stp_10.42.42.5(pid=3423) [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3423)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3436): Process ended prematurely: osmo-stp_10.42.42.5(pid=3436) [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3436)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=3446): Process ended prematurely: osmo-stp_10.42.42.5(pid=3446) [trial-2352↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3446)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3459): Process ended prematurely: osmo-stp_10.42.42.5(pid=3459) [trial-2352↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3459)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3472): Process ended prematurely: osmo-stp_10.42.42.5(pid=3472) [trial-2352↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3472)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=3480): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3480) [trial-2352↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3480)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3490): Process ended prematurely: osmo-stp_10.42.42.5(pid=3490) [trial-2352↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3490)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=3499): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3499) [trial-2352↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3499)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=3510): Process ended prematurely: osmo-stp_10.42.42.5(pid=3510) [trial-2352↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3510)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3524): Process ended prematurely: osmo-stp_10.42.42.5(pid=3524) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3524)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3535): Process ended prematurely: osmo-stp_10.42.42.5(pid=3535) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3535)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3549): Process ended prematurely: osmo-stp_10.42.42.5(pid=3549) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3560): Process ended prematurely: osmo-stp_10.42.42.5(pid=3560) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3560)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3574): Process ended prematurely: osmo-stp_10.42.42.5(pid=3574) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3585): Process ended prematurely: osmo-stp_10.42.42.5(pid=3585) [trial-2352↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3585)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3599): Process ended prematurely: osmo-stp_10.42.42.5(pid=3599) [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3599)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3613): Process ended prematurely: osmo-stp_10.42.42.5(pid=3613) [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3613)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3627): Process ended prematurely: osmo-stp_10.42.42.5(pid=3627) [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3627)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3638): Process ended prematurely: osmo-stp_10.42.42.5(pid=3638) [trial-2352↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3638)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=3924): Process ended prematurely: osmo-stp_10.42.42.5(pid=3924) [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3924)] FAIL: mo_mt_call_osmux.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=3935): Process ended prematurely: osmo-stp_10.42.42.5(pid=3935) [trial-2352↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3935)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3950): Process ended prematurely: osmo-stp_10.42.42.5(pid=3950) [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3950)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3961): Process ended prematurely: osmo-stp_10.42.42.5(pid=3961) [trial-2352↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3961)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3976): Process ended prematurely: osmo-stp_10.42.42.5(pid=3976) [trial-2352↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3976)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3989): Process ended prematurely: osmo-stp_10.42.42.5(pid=3989) [trial-2352↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3989)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=4007): Process ended prematurely: osmo-stp_10.42.42.5(pid=4007) [trial-2352↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4007)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4019): Process ended prematurely: osmo-stp_10.42.42.5(pid=4019) [trial-2352↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4019)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=4037): Process ended prematurely: osmo-stp_10.42.42.5(pid=4037) [trial-2352↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4037)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4050): Process ended prematurely: osmo-stp_10.42.42.5(pid=4050) [trial-2352↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4050)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4060): Process ended prematurely: osmo-stp_10.42.42.5(pid=4060) [trial-2352↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4060)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=4077): Process ended prematurely: osmo-stp_10.42.42.5(pid=4077) [trial-2352↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4077)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4089): Process ended prematurely: osmo-stp_10.42.42.5(pid=4089) [trial-2352↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4089)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=4107): Process ended prematurely: osmo-stp_10.42.42.5(pid=4107) [trial-2352↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4107)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4117): Process ended prematurely: osmo-stp_10.42.42.5(pid=4117) [trial-2352↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4117)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4127): Process ended prematurely: osmo-stp_10.42.42.5(pid=4127) [trial-2352↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4127)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=4144): Process ended prematurely: osmo-stp_10.42.42.5(pid=4144) [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4144)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=4156): Process ended prematurely: osmo-stp_10.42.42.5(pid=4156) [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4156)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=4174): Process ended prematurely: osmo-stp_10.42.42.5(pid=4174) [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4174)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4184): Process ended prematurely: osmo-stp_10.42.42.5(pid=4184) [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4184)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4194): Process ended prematurely: osmo-stp_10.42.42.5(pid=4194) [trial-2352↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4194)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=4211): Process ended prematurely: osmo-stp_10.42.42.5(pid=4211) [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4211)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=4230): Process ended prematurely: osmo-stp_10.42.42.5(pid=4230) [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4230)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=4248): Process ended prematurely: osmo-stp_10.42.42.5(pid=4248) [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4248)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4258): Process ended prematurely: osmo-stp_10.42.42.5(pid=4258) [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4258)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4269): Process ended prematurely: osmo-stp_10.42.42.5(pid=4269) [trial-2352↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4269)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4282): Process ended prematurely: osmo-stp_10.42.42.5(pid=4282) [trial-2352↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4282)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4297): Process ended prematurely: osmo-stp_10.42.42.5(pid=4297) [trial-2352↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4297)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=4305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4305) [trial-2352↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4305)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=4316): Process ended prematurely: osmo-stp_10.42.42.5(pid=4316) [trial-2352↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4316)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=4326): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4326) [trial-2352↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4326)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=4336): Process ended prematurely: osmo-stp_10.42.42.5(pid=4336) [trial-2352↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4336)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4350): Process ended prematurely: osmo-stp_10.42.42.5(pid=4350) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4350)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4361): Process ended prematurely: osmo-stp_10.42.42.5(pid=4361) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4361)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4375): Process ended prematurely: osmo-stp_10.42.42.5(pid=4375) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4375)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4386): Process ended prematurely: osmo-stp_10.42.42.5(pid=4386) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4386)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4400): Process ended prematurely: osmo-stp_10.42.42.5(pid=4400) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4400)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4414): Process ended prematurely: osmo-stp_10.42.42.5(pid=4414) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4414)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4428): Process ended prematurely: osmo-stp_10.42.42.5(pid=4428) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4428)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4439): Process ended prematurely: osmo-stp_10.42.42.5(pid=4439) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4439)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4453): Process ended prematurely: osmo-stp_10.42.42.5(pid=4453) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4453)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4464): Process ended prematurely: osmo-stp_10.42.42.5(pid=4464) [trial-2352↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4464)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4479): Process ended prematurely: osmo-stp_10.42.42.5(pid=4479) [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4479)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4490): Process ended prematurely: osmo-stp_10.42.42.5(pid=4490) [trial-2352↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4490)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4504): Process ended prematurely: osmo-stp_10.42.42.5(pid=4504) [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4504)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4515): Process ended prematurely: osmo-stp_10.42.42.5(pid=4515) [trial-2352↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4515)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4529): Process ended prematurely: osmo-stp_10.42.42.5(pid=4529) [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4540): Process ended prematurely: osmo-stp_10.42.42.5(pid=4540) [trial-2352↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4540)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4554): Process ended prematurely: osmo-stp_10.42.42.5(pid=4554) [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4554)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4565): Process ended prematurely: osmo-stp_10.42.42.5(pid=4565) [trial-2352↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4579): Process ended prematurely: osmo-stp_10.42.42.5(pid=4579) [trial-2352↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4579)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4591): Process ended prematurely: osmo-stp_10.42.42.5(pid=4591) [trial-2352↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4591)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=4609): Process ended prematurely: osmo-stp_10.42.42.5(pid=4609) [trial-2352↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4609)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4622): Process ended prematurely: osmo-stp_10.42.42.5(pid=4622) [trial-2352↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4622)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=4640): Process ended prematurely: osmo-stp_10.42.42.5(pid=4640) [trial-2352↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4640)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4651): Process ended prematurely: osmo-stp_10.42.42.5(pid=4651) [trial-2352↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4651)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4661): Process ended prematurely: osmo-stp_10.42.42.5(pid=4661) [trial-2352↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4661)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=4678): Process ended prematurely: osmo-stp_10.42.42.5(pid=4678) [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4678)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4695): Process ended prematurely: osmo-stp_10.42.42.5(pid=4695) [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4695)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=4713): Process ended prematurely: osmo-stp_10.42.42.5(pid=4713) [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4713)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4723): Process ended prematurely: osmo-stp_10.42.42.5(pid=4723) [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4723)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4733): Process ended prematurely: osmo-stp_10.42.42.5(pid=4733) [trial-2352↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4733)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=4750): Process ended prematurely: osmo-stp_10.42.42.5(pid=4750) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4750)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4765): Process ended prematurely: osmo-stp_10.42.42.5(pid=4765) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4765)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=4783): Process ended prematurely: osmo-stp_10.42.42.5(pid=4783) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4783)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4793): Process ended prematurely: osmo-stp_10.42.42.5(pid=4793) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4793)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4803): Process ended prematurely: osmo-stp_10.42.42.5(pid=4803) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4803)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=4821): Process ended prematurely: osmo-stp_10.42.42.5(pid=4821) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4821)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=4833): Process ended prematurely: osmo-stp_10.42.42.5(pid=4833) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4833)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=4851): Process ended prematurely: osmo-stp_10.42.42.5(pid=4851) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4851)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4861): Process ended prematurely: osmo-stp_10.42.42.5(pid=4861) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4861)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4872): Process ended prematurely: osmo-stp_10.42.42.5(pid=4872) [trial-2352↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4872)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=4889): Process ended prematurely: osmo-stp_10.42.42.5(pid=4889) [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4889)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=4901): Process ended prematurely: osmo-stp_10.42.42.5(pid=4901) [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4901)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=4919): Process ended prematurely: osmo-stp_10.42.42.5(pid=4919) [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4919)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4929): Process ended prematurely: osmo-stp_10.42.42.5(pid=4929) [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4929)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4940): Process ended prematurely: osmo-stp_10.42.42.5(pid=4940) [trial-2352↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4940)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4953): Process ended prematurely: osmo-stp_10.42.42.5(pid=4953) [trial-2352↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4953)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=5237): Process ended prematurely: osmo-stp_10.42.42.5(pid=5237) [trial-2352↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5237)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=5245): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5245) [trial-2352↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5245)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5256): Process ended prematurely: osmo-stp_10.42.42.5(pid=5256) [trial-2352↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5256)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=5265): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5265) [trial-2352↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5265)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5276): Process ended prematurely: osmo-stp_10.42.42.5(pid=5276) [trial-2352↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5276)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5291): Process ended prematurely: osmo-stp_10.42.42.5(pid=5291) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5291)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5302): Process ended prematurely: osmo-stp_10.42.42.5(pid=5302) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5302)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5316): Process ended prematurely: osmo-stp_10.42.42.5(pid=5316) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5316)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5327): Process ended prematurely: osmo-stp_10.42.42.5(pid=5327) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5327)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5341): Process ended prematurely: osmo-stp_10.42.42.5(pid=5341) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5341)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5352): Process ended prematurely: osmo-stp_10.42.42.5(pid=5352) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5352)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5366): Process ended prematurely: osmo-stp_10.42.42.5(pid=5366) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5366)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5380): Process ended prematurely: osmo-stp_10.42.42.5(pid=5380) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5380)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5394): Process ended prematurely: osmo-stp_10.42.42.5(pid=5394) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5394)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5407): Process ended prematurely: osmo-stp_10.42.42.5(pid=5407) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5407)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5421): Process ended prematurely: osmo-stp_10.42.42.5(pid=5421) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5421)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5432): Process ended prematurely: osmo-stp_10.42.42.5(pid=5432) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5432)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5446): Process ended prematurely: osmo-stp_10.42.42.5(pid=5446) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5446)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5457): Process ended prematurely: osmo-stp_10.42.42.5(pid=5457) [trial-2352↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5457)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5471): Process ended prematurely: osmo-stp_10.42.42.5(pid=5471) [trial-2352↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5471)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5482): Process ended prematurely: osmo-stp_10.42.42.5(pid=5482) [trial-2352↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5482)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5500): Process ended prematurely: osmo-stp_10.42.42.5(pid=5500) [trial-2352↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5500)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=5512): Process ended prematurely: osmo-stp_10.42.42.5(pid=5512) [trial-2352↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5512)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=5530): Process ended prematurely: osmo-stp_10.42.42.5(pid=5530) [trial-2352↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5530)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5543): Process ended prematurely: osmo-stp_10.42.42.5(pid=5543) [trial-2352↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5543)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5553): Process ended prematurely: osmo-stp_10.42.42.5(pid=5553) [trial-2352↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5553)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5571): Process ended prematurely: osmo-stp_10.42.42.5(pid=5571) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5571)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=5583): Process ended prematurely: osmo-stp_10.42.42.5(pid=5583) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5583)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=5601): Process ended prematurely: osmo-stp_10.42.42.5(pid=5601) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5601)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5612): Process ended prematurely: osmo-stp_10.42.42.5(pid=5612) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5612)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5622): Process ended prematurely: osmo-stp_10.42.42.5(pid=5622) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5622)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5639): Process ended prematurely: osmo-stp_10.42.42.5(pid=5639) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5639)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5652): Process ended prematurely: osmo-stp_10.42.42.5(pid=5652) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5652)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=5670): Process ended prematurely: osmo-stp_10.42.42.5(pid=5670) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5670)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5682): Process ended prematurely: osmo-stp_10.42.42.5(pid=5682) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5682)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5692): Process ended prematurely: osmo-stp_10.42.42.5(pid=5692) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5692)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=5710): Process ended prematurely: osmo-stp_10.42.42.5(pid=5710) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5710)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5725): Process ended prematurely: osmo-stp_10.42.42.5(pid=5725) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5725)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=5743): Process ended prematurely: osmo-stp_10.42.42.5(pid=5743) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5743)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5753): Process ended prematurely: osmo-stp_10.42.42.5(pid=5753) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5753)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=5763): Process ended prematurely: osmo-stp_10.42.42.5(pid=5763) [trial-2352↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5763)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5776): Process ended prematurely: osmo-stp_10.42.42.5(pid=5776) [trial-2352↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5776)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5789): Process ended prematurely: osmo-stp_10.42.42.5(pid=5789) [trial-2352↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5789)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=5797): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5797) [trial-2352↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5797)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5807): Process ended prematurely: osmo-stp_10.42.42.5(pid=5807) [trial-2352↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5807)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=5816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5816) [trial-2352↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5816)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=5826): Process ended prematurely: osmo-stp_10.42.42.5(pid=5826) [trial-2352↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5826)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5840): Process ended prematurely: osmo-stp_10.42.42.5(pid=5840) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5840)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5854): Process ended prematurely: osmo-stp_10.42.42.5(pid=5854) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5854)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5869): Process ended prematurely: osmo-stp_10.42.42.5(pid=5869) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5869)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5880): Process ended prematurely: osmo-stp_10.42.42.5(pid=5880) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5880)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5894): Process ended prematurely: osmo-stp_10.42.42.5(pid=5894) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5894)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5906): Process ended prematurely: osmo-stp_10.42.42.5(pid=5906) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5906)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5920): Process ended prematurely: osmo-stp_10.42.42.5(pid=5920) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5920)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5931): Process ended prematurely: osmo-stp_10.42.42.5(pid=5931) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5931)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5945): Process ended prematurely: osmo-stp_10.42.42.5(pid=5945) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5945)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5956): Process ended prematurely: osmo-stp_10.42.42.5(pid=5956) [trial-2352↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5956)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5970): Process ended prematurely: osmo-stp_10.42.42.5(pid=5970) [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5970)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5981): Process ended prematurely: osmo-stp_10.42.42.5(pid=5981) [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5981)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5997): Process ended prematurely: osmo-stp_10.42.42.5(pid=5997) [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5997)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6009): Process ended prematurely: osmo-stp_10.42.42.5(pid=6009) [trial-2352↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6009)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6024): Process ended prematurely: osmo-stp_10.42.42.5(pid=6024) [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6024)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6035): Process ended prematurely: osmo-stp_10.42.42.5(pid=6035) [trial-2352↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6035)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6050): Process ended prematurely: osmo-stp_10.42.42.5(pid=6050) [trial-2352↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6050)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6061): Process ended prematurely: osmo-stp_10.42.42.5(pid=6061) [trial-2352↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6061)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=6082): Process ended prematurely: osmo-stp_10.42.42.5(pid=6082) [trial-2352↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6082)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6095): Process ended prematurely: osmo-stp_10.42.42.5(pid=6095) [trial-2352↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6095)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=6113): Process ended prematurely: osmo-stp_10.42.42.5(pid=6113) [trial-2352↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6113)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6123): Process ended prematurely: osmo-stp_10.42.42.5(pid=6123) [trial-2352↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6123)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=6133): Process ended prematurely: osmo-stp_10.42.42.5(pid=6133) [trial-2352↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6133)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=6151): Process ended prematurely: osmo-stp_10.42.42.5(pid=6151) [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6151)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6163): Process ended prematurely: osmo-stp_10.42.42.5(pid=6163) [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6163)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=6181): Process ended prematurely: osmo-stp_10.42.42.5(pid=6181) [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6181)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6191): Process ended prematurely: osmo-stp_10.42.42.5(pid=6191) [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6191)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6201): Process ended prematurely: osmo-stp_10.42.42.5(pid=6201) [trial-2352↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6201)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=6218): Process ended prematurely: osmo-stp_10.42.42.5(pid=6218) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6218)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6230): Process ended prematurely: osmo-stp_10.42.42.5(pid=6230) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6230)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=6252): Process ended prematurely: osmo-stp_10.42.42.5(pid=6252) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6252)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6262): Process ended prematurely: osmo-stp_10.42.42.5(pid=6262) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6262)] FAIL: ping_idle_ping.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=6503): Process ended prematurely: osmo-stp_10.42.42.5(pid=6503) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6503)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=6560): Process ended prematurely: osmo-stp_10.42.42.5(pid=6560) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6560)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=6573): Process ended prematurely: osmo-stp_10.42.42.5(pid=6573) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6573)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=6593): Process ended prematurely: osmo-stp_10.42.42.5(pid=6593) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6593)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6603): Process ended prematurely: osmo-stp_10.42.42.5(pid=6603) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6603)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6613): Process ended prematurely: osmo-stp_10.42.42.5(pid=6613) [trial-2352↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6613)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=6630): Process ended prematurely: osmo-stp_10.42.42.5(pid=6630) [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6630)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6643): Process ended prematurely: osmo-stp_10.42.42.5(pid=6643) [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6643)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=6661): Process ended prematurely: osmo-stp_10.42.42.5(pid=6661) [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6661)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6671): Process ended prematurely: osmo-stp_10.42.42.5(pid=6671) [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6671)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6684): Process ended prematurely: osmo-stp_10.42.42.5(pid=6684) [trial-2352↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6684)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6697): Process ended prematurely: osmo-stp_10.42.42.5(pid=6697) [trial-2352↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6697)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6710): Process ended prematurely: osmo-stp_10.42.42.5(pid=6710) [trial-2352↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6710)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=6719): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6719) [trial-2352↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6719)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6729): Process ended prematurely: osmo-stp_10.42.42.5(pid=6729) [trial-2352↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6729)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6738): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6738) [trial-2352↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6738)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6748): Process ended prematurely: osmo-stp_10.42.42.5(pid=6748) [trial-2352↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6748)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6763): Process ended prematurely: osmo-stp_10.42.42.5(pid=6763) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6763)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6774): Process ended prematurely: osmo-stp_10.42.42.5(pid=6774) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6774)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6789): Process ended prematurely: osmo-stp_10.42.42.5(pid=6789) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6789)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6800): Process ended prematurely: osmo-stp_10.42.42.5(pid=6800) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6800)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=6814): Process ended prematurely: osmo-stp_10.42.42.5(pid=6814) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6814)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6825): Process ended prematurely: osmo-stp_10.42.42.5(pid=6825) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6825)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6839): Process ended prematurely: osmo-stp_10.42.42.5(pid=6839) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6839)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6850): Process ended prematurely: osmo-stp_10.42.42.5(pid=6850) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6850)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6866): Process ended prematurely: osmo-stp_10.42.42.5(pid=6866) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6866)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6877): Process ended prematurely: osmo-stp_10.42.42.5(pid=6877) [trial-2352↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6877)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6891): Process ended prematurely: osmo-stp_10.42.42.5(pid=6891) [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6891)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6902): Process ended prematurely: osmo-stp_10.42.42.5(pid=6902) [trial-2352↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6902)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6916): Process ended prematurely: osmo-stp_10.42.42.5(pid=6916) [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6916)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6927): Process ended prematurely: osmo-stp_10.42.42.5(pid=6927) [trial-2352↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6927)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6941): Process ended prematurely: osmo-stp_10.42.42.5(pid=6941) [trial-2352↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6941)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6952): Process ended prematurely: osmo-stp_10.42.42.5(pid=6952) [trial-2352↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6952)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=6972): Process ended prematurely: osmo-stp_10.42.42.5(pid=6972) [trial-2352↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6972)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6985): Process ended prematurely: osmo-stp_10.42.42.5(pid=6985) [trial-2352↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6985)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7003): Process ended prematurely: osmo-stp_10.42.42.5(pid=7003) [trial-2352↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7003)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7014): Process ended prematurely: osmo-stp_10.42.42.5(pid=7014) [trial-2352↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7014)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7024): Process ended prematurely: osmo-stp_10.42.42.5(pid=7024) [trial-2352↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7024)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7044): Process ended prematurely: osmo-stp_10.42.42.5(pid=7044) [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7044)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7056): Process ended prematurely: osmo-stp_10.42.42.5(pid=7056) [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7056)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7074): Process ended prematurely: osmo-stp_10.42.42.5(pid=7074) [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7074)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7084): Process ended prematurely: osmo-stp_10.42.42.5(pid=7084) [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7084)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7094): Process ended prematurely: osmo-stp_10.42.42.5(pid=7094) [trial-2352↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7094)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=7111): Process ended prematurely: osmo-stp_10.42.42.5(pid=7111) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7111)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7123): Process ended prematurely: osmo-stp_10.42.42.5(pid=7123) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7123)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=7141): Process ended prematurely: osmo-stp_10.42.42.5(pid=7141) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7141)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7152): Process ended prematurely: osmo-stp_10.42.42.5(pid=7152) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7152)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7162): Process ended prematurely: osmo-stp_10.42.42.5(pid=7162) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7162)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=7180): Process ended prematurely: osmo-stp_10.42.42.5(pid=7180) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7180)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=7192): Process ended prematurely: osmo-stp_10.42.42.5(pid=7192) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7192)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=7210): Process ended prematurely: osmo-stp_10.42.42.5(pid=7210) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7210)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7224): Process ended prematurely: osmo-stp_10.42.42.5(pid=7224) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7224)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7234): Process ended prematurely: osmo-stp_10.42.42.5(pid=7234) [trial-2352↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7234)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7249): Process ended prematurely: osmo-stp_10.42.42.5(pid=7249) [trial-2352↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7249)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7262): Process ended prematurely: osmo-stp_10.42.42.5(pid=7262) [trial-2352↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7262)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=7270): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7270) [trial-2352↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7270)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=7280): Process ended prematurely: osmo-stp_10.42.42.5(pid=7280) [trial-2352↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7280)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7289): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7289) [trial-2352↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7289)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=7299): Process ended prematurely: osmo-stp_10.42.42.5(pid=7299) [trial-2352↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7299)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7313): Process ended prematurely: osmo-stp_10.42.42.5(pid=7313) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7313)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7324): Process ended prematurely: osmo-stp_10.42.42.5(pid=7324) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7324)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7338): Process ended prematurely: osmo-stp_10.42.42.5(pid=7338) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7338)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7349): Process ended prematurely: osmo-stp_10.42.42.5(pid=7349) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7349)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7364): Process ended prematurely: osmo-stp_10.42.42.5(pid=7364) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7364)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7375): Process ended prematurely: osmo-stp_10.42.42.5(pid=7375) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7375)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7392): Process ended prematurely: osmo-stp_10.42.42.5(pid=7392) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7392)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7403): Process ended prematurely: osmo-stp_10.42.42.5(pid=7403) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7403)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7417): Process ended prematurely: osmo-stp_10.42.42.5(pid=7417) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7417)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7428): Process ended prematurely: osmo-stp_10.42.42.5(pid=7428) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7428)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7442): Process ended prematurely: osmo-stp_10.42.42.5(pid=7442) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7442)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7453): Process ended prematurely: osmo-stp_10.42.42.5(pid=7453) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7453)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7468): Process ended prematurely: osmo-stp_10.42.42.5(pid=7468) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7468)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7479): Process ended prematurely: osmo-stp_10.42.42.5(pid=7479) [trial-2352↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7479)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7494): Process ended prematurely: osmo-stp_10.42.42.5(pid=7494) [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7494)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7505): Process ended prematurely: osmo-stp_10.42.42.5(pid=7505) [trial-2352↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7505)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=7523): Process ended prematurely: osmo-stp_10.42.42.5(pid=7523) [trial-2352↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7523)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=7535): Process ended prematurely: osmo-stp_10.42.42.5(pid=7535) [trial-2352↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7535)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=7553): Process ended prematurely: osmo-stp_10.42.42.5(pid=7553) [trial-2352↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7553)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7568): Process ended prematurely: osmo-stp_10.42.42.5(pid=7568) [trial-2352↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7568)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7578): Process ended prematurely: osmo-stp_10.42.42.5(pid=7578) [trial-2352↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7578)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=7644): Process ended prematurely: osmo-stp_10.42.42.5(pid=7644) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7644)] FAIL: iperf3.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=7879): Process ended prematurely: osmo-stp_10.42.42.5(pid=7879) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7879)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7897): Process ended prematurely: osmo-stp_10.42.42.5(pid=7897) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7897)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7907): Process ended prematurely: osmo-stp_10.42.42.5(pid=7907) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7907)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7917): Process ended prematurely: osmo-stp_10.42.42.5(pid=7917) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7917)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=7936): Process ended prematurely: osmo-stp_10.42.42.5(pid=7936) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7936)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7948): Process ended prematurely: osmo-stp_10.42.42.5(pid=7948) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7948)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=7966): Process ended prematurely: osmo-stp_10.42.42.5(pid=7966) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7976): Process ended prematurely: osmo-stp_10.42.42.5(pid=7976) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7976)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7986): Process ended prematurely: osmo-stp_10.42.42.5(pid=7986) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7986)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=8008): Process ended prematurely: osmo-stp_10.42.42.5(pid=8008) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8008)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8020): Process ended prematurely: osmo-stp_10.42.42.5(pid=8020) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8020)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=8038): Process ended prematurely: osmo-stp_10.42.42.5(pid=8038) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8038)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8049): Process ended prematurely: osmo-stp_10.42.42.5(pid=8049) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8049)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8059): Process ended prematurely: osmo-stp_10.42.42.5(pid=8059) [trial-2352↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8059)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8072): Process ended prematurely: osmo-stp_10.42.42.5(pid=8072) [trial-2352↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8072)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8085): Process ended prematurely: osmo-stp_10.42.42.5(pid=8085) [trial-2352↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8085)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=8094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8094) [trial-2352↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8094)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8104): Process ended prematurely: osmo-stp_10.42.42.5(pid=8104) [trial-2352↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8104)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=8114): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8114) [trial-2352↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8114)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8124): Process ended prematurely: osmo-stp_10.42.42.5(pid=8124) [trial-2352↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8124)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8138): Process ended prematurely: osmo-stp_10.42.42.5(pid=8138) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8138)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8154): Process ended prematurely: osmo-stp_10.42.42.5(pid=8154) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8154)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8168): Process ended prematurely: osmo-stp_10.42.42.5(pid=8168) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8168)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8179): Process ended prematurely: osmo-stp_10.42.42.5(pid=8179) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8179)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8193): Process ended prematurely: osmo-stp_10.42.42.5(pid=8193) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8193)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8204): Process ended prematurely: osmo-stp_10.42.42.5(pid=8204) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8204)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8218): Process ended prematurely: osmo-stp_10.42.42.5(pid=8218) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8218)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8229): Process ended prematurely: osmo-stp_10.42.42.5(pid=8229) [trial-2352↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8229)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8243): Process ended prematurely: osmo-stp_10.42.42.5(pid=8243) [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8243)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8254): Process ended prematurely: osmo-stp_10.42.42.5(pid=8254) [trial-2352↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8254)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8268): Process ended prematurely: osmo-stp_10.42.42.5(pid=8268) [trial-2352↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8268)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8279): Process ended prematurely: osmo-stp_10.42.42.5(pid=8279) [trial-2352↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8279)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=8300): Process ended prematurely: osmo-stp_10.42.42.5(pid=8300) [trial-2352↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8300)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=8312): Process ended prematurely: osmo-stp_10.42.42.5(pid=8312) [trial-2352↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8312)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=8330): Process ended prematurely: osmo-stp_10.42.42.5(pid=8330) [trial-2352↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8330)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8340): Process ended prematurely: osmo-stp_10.42.42.5(pid=8340) [trial-2352↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8340)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8350): Process ended prematurely: osmo-stp_10.42.42.5(pid=8350) [trial-2352↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8350)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=8371): Process ended prematurely: osmo-stp_10.42.42.5(pid=8371) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8371)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8383): Process ended prematurely: osmo-stp_10.42.42.5(pid=8383) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8383)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8401): Process ended prematurely: osmo-stp_10.42.42.5(pid=8401) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8401)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8411): Process ended prematurely: osmo-stp_10.42.42.5(pid=8411) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8411)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8421): Process ended prematurely: osmo-stp_10.42.42.5(pid=8421) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8421)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=8438): Process ended prematurely: osmo-stp_10.42.42.5(pid=8438) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8438)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=8450): Process ended prematurely: osmo-stp_10.42.42.5(pid=8450) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8450)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=8468): Process ended prematurely: osmo-stp_10.42.42.5(pid=8468) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8468)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8478): Process ended prematurely: osmo-stp_10.42.42.5(pid=8478) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8478)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8488): Process ended prematurely: osmo-stp_10.42.42.5(pid=8488) [trial-2352↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8488)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8502): Process ended prematurely: osmo-stp_10.42.42.5(pid=8502) [trial-2352↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8502)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8516): Process ended prematurely: osmo-stp_10.42.42.5(pid=8516) [trial-2352↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8516)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=8525): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8525) [trial-2352↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8525)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8537): Process ended prematurely: osmo-stp_10.42.42.5(pid=8537) [trial-2352↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8537)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8551): Process ended prematurely: osmo-stp_10.42.42.5(pid=8551) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8551)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8562): Process ended prematurely: osmo-stp_10.42.42.5(pid=8562) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8562)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8576): Process ended prematurely: osmo-stp_10.42.42.5(pid=8576) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8576)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8588): Process ended prematurely: osmo-stp_10.42.42.5(pid=8588) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8588)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8602): Process ended prematurely: osmo-stp_10.42.42.5(pid=8602) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8602)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8613): Process ended prematurely: osmo-stp_10.42.42.5(pid=8613) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8613)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8627): Process ended prematurely: osmo-stp_10.42.42.5(pid=8627) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8627)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8638): Process ended prematurely: osmo-stp_10.42.42.5(pid=8638) [trial-2352↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8638)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8652): Process ended prematurely: osmo-stp_10.42.42.5(pid=8652) [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8652)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8663): Process ended prematurely: osmo-stp_10.42.42.5(pid=8663) [trial-2352↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8663)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8677): Process ended prematurely: osmo-stp_10.42.42.5(pid=8677) [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8677)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8688): Process ended prematurely: osmo-stp_10.42.42.5(pid=8688) [trial-2352↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8688)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8702): Process ended prematurely: osmo-stp_10.42.42.5(pid=8702) [trial-2352↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8702)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8716): Process ended prematurely: osmo-stp_10.42.42.5(pid=8716) [trial-2352↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8716)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8734): Process ended prematurely: osmo-stp_10.42.42.5(pid=8734) [trial-2352↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8734)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=8747): Process ended prematurely: osmo-stp_10.42.42.5(pid=8747) [trial-2352↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8747)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8765): Process ended prematurely: osmo-stp_10.42.42.5(pid=8765) [trial-2352↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8765)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8775): Process ended prematurely: osmo-stp_10.42.42.5(pid=8775) [trial-2352↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8775)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8785): Process ended prematurely: osmo-stp_10.42.42.5(pid=8785) [trial-2352↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8785)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=8803): Process ended prematurely: osmo-stp_10.42.42.5(pid=8803) [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8803)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=8815): Process ended prematurely: osmo-stp_10.42.42.5(pid=8815) [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8815)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=8833): Process ended prematurely: osmo-stp_10.42.42.5(pid=8833) [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8833)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8843): Process ended prematurely: osmo-stp_10.42.42.5(pid=8843) [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8843)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8853): Process ended prematurely: osmo-stp_10.42.42.5(pid=8853) [trial-2352↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8853)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8871): Process ended prematurely: osmo-stp_10.42.42.5(pid=8871) [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8871)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=8891): Process ended prematurely: osmo-stp_10.42.42.5(pid=8891) [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8891)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=8909): Process ended prematurely: osmo-stp_10.42.42.5(pid=8909) [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8909)] FAIL: ping.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=9188): Process ended prematurely: osmo-stp_10.42.42.5(pid=9188) [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9188)] FAIL: ping_idle_ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9200): Process ended prematurely: osmo-stp_10.42.42.5(pid=9200) [trial-2352↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9200)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=9218): Process ended prematurely: osmo-stp_10.42.42.5(pid=9218) [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9218)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=9230): Process ended prematurely: osmo-stp_10.42.42.5(pid=9230) [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9230)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=9249): Process ended prematurely: osmo-stp_10.42.42.5(pid=9249) [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9249)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9259): Process ended prematurely: osmo-stp_10.42.42.5(pid=9259) [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9259)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9269): Process ended prematurely: osmo-stp_10.42.42.5(pid=9269) [trial-2352↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9269)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9283): Process ended prematurely: osmo-stp_10.42.42.5(pid=9283) [trial-2352↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9283)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=9291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9291) [trial-2352↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9291)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=9293): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9293) [trial-2352↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9293)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=9295): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9295) [trial-2352↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9295)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9297): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9297) [trial-2352↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9297)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.5 sec) Error: osmo-hlr_10.42.42.2(pid=9306): Process ended prematurely: osmo-hlr_10.42.42.2(pid=9306) [trial-2352↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9306)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=9317): Process ended prematurely: osmo-hlr_10.42.42.2(pid=9317) [trial-2352↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9317)] FAIL: esme_ms_sms_storeforward.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9332): Process ended prematurely: osmo-stp_10.42.42.5(pid=9332) [trial-2352↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9332)] FAIL: esme_ms_sms_transaction.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9343): Process ended prematurely: osmo-stp_10.42.42.5(pid=9343) [trial-2352↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9343)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9358): Process ended prematurely: osmo-stp_10.42.42.5(pid=9358) [trial-2352↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9358)] FAIL: register_a5_0_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9369): Process ended prematurely: osmo-stp_10.42.42.5(pid=9369) [trial-2352↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9369)] FAIL: register_a5_1_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9381): Process ended prematurely: osmo-stp_10.42.42.5(pid=9381) [trial-2352↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9381)] FAIL: register_a5_3_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9392): Process ended prematurely: osmo-stp_10.42.42.5(pid=9392) [trial-2352↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9392)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.0 sec) Error: srsepc(pid=9412): Process ended prematurely: srsepc(pid=9412) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9412)] FAIL: iperf3_bidir.py (18.8 sec) Error: srsepc(pid=9428): Process ended prematurely: srsepc(pid=9428) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9428)] FAIL: iperf3_dl.py (19.1 sec) Error: srsepc(pid=9444): Process ended prematurely: srsepc(pid=9444) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9444)] FAIL: iperf3_ul.py (18.8 sec) Error: srsepc(pid=9460): Process ended prematurely: srsepc(pid=9460) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9460)] FAIL: ping.py (18.7 sec) Error: srsepc(pid=9476): Process ended prematurely: srsepc(pid=9476) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9476)] FAIL: rrc_idle_mo_ping.py (18.7 sec) Error: srsepc(pid=9494): Process ended prematurely: srsepc(pid=9494) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9494)] FAIL: rrc_idle_mt_ping.py (18.4 sec) Error: srsepc(pid=9510): Process ended prematurely: srsepc(pid=9510) [trial-2352↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=9510)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9523): Process ended prematurely: osmo-stp_10.42.42.5(pid=9523) [trial-2352↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9523)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9537): Process ended prematurely: osmo-stp_10.42.42.5(pid=9537) [trial-2352↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9537)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9551): Process ended prematurely: osmo-stp_10.42.42.5(pid=9551) [trial-2352↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9551)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9565): Process ended prematurely: osmo-stp_10.42.42.5(pid=9565) [trial-2352↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9565)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9579): Process ended prematurely: osmo-stp_10.42.42.5(pid=9579) [trial-2352↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9579)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=9593): Process ended prematurely: osmo-stp_10.42.42.5(pid=9593) [trial-2352↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9593)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9607): Process ended prematurely: osmo-stp_10.42.42.5(pid=9607) [trial-2352↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9622): Process ended prematurely: osmo-stp_10.42.42.5(pid=9622) [trial-2352↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9622)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9637): Process ended prematurely: osmo-stp_10.42.42.5(pid=9637) [trial-2352↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9637)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9654): Process ended prematurely: osmo-stp_10.42.42.5(pid=9654) [trial-2352↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9654)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9668): Process ended prematurely: osmo-stp_10.42.42.5(pid=9668) [trial-2352↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9668)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9682): Process ended prematurely: osmo-stp_10.42.42.5(pid=9682) [trial-2352↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9682)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9696): Process ended prematurely: osmo-stp_10.42.42.5(pid=9696) [trial-2352↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9696)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9711): Process ended prematurely: osmo-stp_10.42.42.5(pid=9711) [trial-2352↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9711)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=9725): Process ended prematurely: osmo-stp_10.42.42.5(pid=9725) [trial-2352↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9725)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9739): Process ended prematurely: osmo-stp_10.42.42.5(pid=9739) [trial-2352↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9739)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9753): Process ended prematurely: osmo-stp_10.42.42.5(pid=9753) [trial-2352↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9753)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9767): Process ended prematurely: osmo-stp_10.42.42.5(pid=9767) [trial-2352↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9767)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=9781): Process ended prematurely: osmo-stp_10.42.42.5(pid=9781) [trial-2352↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9781)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9795): Process ended prematurely: osmo-stp_10.42.42.5(pid=9795) [trial-2352↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9795)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9810): Process ended prematurely: osmo-stp_10.42.42.5(pid=9810) [trial-2352↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9810)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9824): Process ended prematurely: osmo-stp_10.42.42.5(pid=9824) [trial-2352↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9824)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9838): Process ended prematurely: osmo-stp_10.42.42.5(pid=9838) [trial-2352↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9838)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9853): Process ended prematurely: osmo-stp_10.42.42.5(pid=9853) [trial-2352↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9853)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9867): Process ended prematurely: osmo-stp_10.42.42.5(pid=9867) [trial-2352↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9867)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9882): Process ended prematurely: osmo-stp_10.42.42.5(pid=9882) [trial-2352↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9882)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9896): Process ended prematurely: osmo-stp_10.42.42.5(pid=9896) [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9896)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9910): Process ended prematurely: osmo-stp_10.42.42.5(pid=9910) [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9910)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9924): Process ended prematurely: osmo-stp_10.42.42.5(pid=9924) [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9924)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9938): Process ended prematurely: osmo-stp_10.42.42.5(pid=9938) [trial-2352↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9938)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9952): Process ended prematurely: osmo-stp_10.42.42.5(pid=9952) [trial-2352↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9966): Process ended prematurely: osmo-stp_10.42.42.5(pid=9966) [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9966)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=9980): Process ended prematurely: osmo-stp_10.42.42.5(pid=9980) [trial-2352↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9980)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9995): Process ended prematurely: osmo-stp_10.42.42.5(pid=9995) [trial-2352↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9995)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10009): Process ended prematurely: osmo-stp_10.42.42.5(pid=10009) [trial-2352↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10009)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10026): Process ended prematurely: osmo-stp_10.42.42.5(pid=10026) [trial-2352↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10026)] + rm -rf trial-2352/inst + cd trial-2352 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 00:40:15 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352-run.tgz run.2022-12-09_00-40-26 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2352-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17648.tgz osmo-bts-oc2g.build-5529.tgz osmo-bts-sysmo.build-8033.tgz osmo-bts.build-7502.tgz osmo-ggsn.build-6676.tgz osmo-hlr.build-8695.tgz osmo-hnbgw.build-2940.tgz osmo-mgw.build-8940.tgz osmo-msc.build-29251.tgz osmo-nitb.build-12961.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30028.tgz osmo-stp.build-9235.tgz osmo-trx.build-4672.tgz osmocom-bb.build-4693.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE